Skip to content

Commit c05bd35

Browse files
PredictabilityAtScalePredictabilityAtScale
committed
WEBSITE: Compared GitHub Models
1 parent e8c0bd6 commit c05bd35

3 files changed

Lines changed: 196 additions & 0 deletions

File tree

‎README.md‎

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,31 @@ Your prompts are already in Git. PromptOpsKit makes them manageable. It replaces
1111

1212
Provider adapters for OpenAI, Anthropic, Gemini, and OpenRouter produce a ready-to-send **request body only** — no HTTP client, no auth, no headers. Your application owns transport, so PromptOpsKit slots into any stack without opinions about how you call the API.
1313

14+
## How is this different from GitHub Models?
15+
16+
GitHub Models is a great place to prototype prompts, compare models, and run evaluations inside GitHub.
17+
18+
PromptOpsKit is focused on the application runtime layer.
19+
20+
It helps you turn prompt behavior into repo-native assets that your application can load, validate, compose, compile, and render into provider-specific request bodies.
21+
22+
Use GitHub Models when you want:
23+
24+
- a GitHub-hosted prompt editor and playground
25+
- side-by-side model comparisons
26+
- structured evaluations inside GitHub
27+
- `.prompt.yml` files for prompt experiments and evals
28+
29+
Use PromptOpsKit when you want:
30+
31+
- Markdown prompt assets with YAML metadata
32+
- production input hardening and validation
33+
- environment-specific model and parameter overrides
34+
- reusable prompt composition
35+
- compiled artifacts for deployment
36+
- provider-specific request bodies for your own runtime code
37+
- control over SDKs, auth, retries, routing, observability, and billing
38+
1439
### Why PromptOpsKit?
1540

1641
- **Centralized, not scattered** — each prompt is a single Markdown file that captures prompt text, model config, tool bindings, and context rules together.

‎website/index.html‎

Lines changed: 129 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -92,6 +92,7 @@
9292
<nav id="primary-nav" aria-label="Primary">
9393
<a href="#why">Why</a>
9494
<a href="#what">What</a>
95+
<a href="#github-models">Compare</a>
9596
<a href="#quickstart">How</a>
9697
<a href="#features">Features</a>
9798
<a href="#faq">FAQ</a>
@@ -235,6 +236,118 @@ <h3>
235236
</article>
236237
</section>
237238

239+
<section
240+
id="github-models"
241+
class="container section section-github-models"
242+
aria-labelledby="github-models-title"
243+
>
244+
<p class="eyebrow">How it compares</p>
245+
<h2 id="github-models-title">
246+
From prompt experiments to production prompt assets
247+
</h2>
248+
<p class="section-intro">
249+
GitHub Models is great for exploring prompts, comparing models, and
250+
running evaluations inside GitHub. PromptOpsKit focuses on what
251+
happens when that behavior needs to ship inside your application.
252+
</p>
253+
<p class="section-intro section-intro-tight">
254+
<strong>
255+
GitHub Models helps you experiment with prompts in GitHub.
256+
PromptOpsKit helps you ship prompt behavior inside your application.
257+
</strong>
258+
</p>
259+
260+
<div class="grid two comparison-grid">
261+
<article class="card comparison-card">
262+
<h3>GitHub Models</h3>
263+
<ul>
264+
<li>Prompt editor and playground inside GitHub</li>
265+
<li>Model comparison and structured evaluations</li>
266+
<li>
267+
Repository-stored <code>.prompt.yml</code> or
268+
<code>.prompt.yaml</code> files
269+
</li>
270+
<li>
271+
Great for experimentation, collaboration, evals, and model
272+
selection
273+
</li>
274+
</ul>
275+
<p class="comparison-note">
276+
GitHub's docs describe prompt files, model parameters, test data,
277+
evaluators, and CLI evals with <code>gh models eval</code>.
278+
</p>
279+
</article>
280+
281+
<article class="card comparison-card comparison-card-strong">
282+
<h3>PromptOpsKit</h3>
283+
<ul>
284+
<li>Markdown prompt assets designed for application runtime</li>
285+
<li>
286+
Input hardening, environment overrides, composition, and
287+
validation
288+
</li>
289+
<li>
290+
Provider-specific request rendering for your own app code
291+
</li>
292+
<li>
293+
Great for shipping prompt behavior through Git, CI, and
294+
production deploys
295+
</li>
296+
</ul>
297+
<p class="comparison-note">
298+
It renders provider-shaped request bodies while your app keeps
299+
control of SDKs, auth, retries, routing, observability, and
300+
billing.
301+
</p>
302+
</article>
303+
</div>
304+
305+
<div class="github-models-points">
306+
<article>
307+
<h3>Runtime-first</h3>
308+
<p>
309+
Turn prompt files into provider-ready request bodies your
310+
application can execute with your own deployment model.
311+
</p>
312+
</article>
313+
<article>
314+
<h3>Markdown-native</h3>
315+
<p>
316+
Keep long system instructions, templates, notes, and examples
317+
readable in Markdown, with YAML front matter for metadata.
318+
</p>
319+
</article>
320+
<article>
321+
<h3>Input hardening</h3>
322+
<p>
323+
Define required variables, size limits, trimming rules, and
324+
allow/deny regex checks next to the prompt.
325+
</p>
326+
</article>
327+
<article>
328+
<h3>Bring your own transport</h3>
329+
<p>
330+
Render OpenAI, Anthropic, Gemini, OpenRouter, or OpenAI Responses
331+
request bodies, then send them through your existing stack.
332+
</p>
333+
</article>
334+
<article>
335+
<h3>Environment-aware</h3>
336+
<p>
337+
Keep dev, staging, production, and tier-specific model settings
338+
close to the prompt and reviewable in Git.
339+
</p>
340+
</article>
341+
<article>
342+
<h3>Composable</h3>
343+
<p>
344+
Reuse shared instructions, policies, and template fragments
345+
across prompts without copying the same blocks everywhere.
346+
</p>
347+
</article>
348+
</div>
349+
</section>
350+
238351
<section id="demo" class="container section section-demo">
239352
<div class="demo-copy">
240353
<p class="eyebrow">See it working</p>
@@ -624,6 +737,22 @@ <h3>Usage-based billing and entitlement checks</h3>
624737
<section id="faq" class="container section">
625738
<h2>Frequently asked questions</h2>
626739
<div class="grid two">
740+
<article class="card">
741+
<h3>How is this different from GitHub Models?</h3>
742+
<p>
743+
GitHub Models is great for experimenting with prompts, comparing
744+
models, and running evaluations inside GitHub. PromptOpsKit
745+
focuses on the application runtime layer: Markdown-based assets
746+
with structured metadata, input validation, environment overrides,
747+
composition, and provider-specific request rendering.
748+
</p>
749+
<p>
750+
In practice, GitHub Models helps you decide what prompt and model
751+
behavior you want. PromptOpsKit helps you ship that behavior
752+
inside your app without replacing your SDK, gateway, auth,
753+
retries, observability, or deployment pipeline.
754+
</p>
755+
</article>
627756
<article class="card">
628757
<h3>What happens when I need to change models?</h3>
629758
<p>

‎website/styles.css‎

Lines changed: 42 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -164,6 +164,44 @@ nav a:hover,
164164
linear-gradient(180deg, #f8fafc 0%, #eef4ff 100%);
165165
}
166166

167+
.comparison-card-strong {
168+
background:
169+
radial-gradient(circle at top right, rgba(20, 184, 166, 0.11), transparent 34%),
170+
linear-gradient(180deg, #f8fafc 0%, #ecfdf5 100%);
171+
}
172+
173+
.comparison-note {
174+
margin: 1rem 0 0;
175+
color: var(--muted);
176+
font-size: 0.95rem;
177+
}
178+
179+
.section-intro-tight {
180+
margin-top: -0.5rem;
181+
}
182+
183+
.github-models-points {
184+
display: grid;
185+
grid-template-columns: repeat(3, minmax(0, 1fr));
186+
gap: 1rem;
187+
margin-top: 1rem;
188+
}
189+
190+
.github-models-points article {
191+
padding-top: 1rem;
192+
border-top: 2px solid var(--line);
193+
}
194+
195+
.github-models-points h3 {
196+
margin-bottom: 0.4rem;
197+
font-size: 1rem;
198+
}
199+
200+
.github-models-points p {
201+
color: var(--muted);
202+
font-size: 0.95rem;
203+
}
204+
167205
.stack-fit-card {
168206
background:
169207
radial-gradient(circle at top left, rgba(15, 23, 42, 0.05), transparent 38%),
@@ -430,6 +468,10 @@ ul {
430468
grid-template-columns: 1fr;
431469
}
432470

471+
.github-models-points {
472+
grid-template-columns: 1fr;
473+
}
474+
433475
.container {
434476
width: min(1080px, calc(100% - 2rem));
435477
}

0 commit comments

Comments
 (0)