You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-**Per-model scoring is the hardest part and the easiest to fake.** Today the weights are illustrative. Real "Claude ranks this higher than GPT-5" requires actually running each agent on each repo. That's `tasks/0.3.0/01-benchmark-harness.md`.
63
+
-**Per-model scoring is the hardest part and the easiest to fake.** Today the weights are illustrative. Real "Claude ranks this higher than GPT-5" requires actually running each agent on each repo. That's `tasks/1.0.0/03-benchmark-harness.md`.
62
64
-**Factory.ai is already in this space.** Differentiation has to stay sharp.
63
-
-**Public-shaming risk.** Ranking #47,823 without consent invites angry maintainers. Planned via `tasks/0.4.0/04-opt-out-claim-flow.md`.
65
+
-**Public-shaming risk.** Ranking #47,823 without consent invites angry maintainers. Planned via `tasks/0.6.0/01-opt-out-claim-flow.md`.
64
66
-**Score gaming.** Once public, people add boilerplate `AGENTS.md` to pass the rubric without being useful. Dynamic (actually-run-an-agent) checks are the counter — see benchmark harness.
65
67
-**Freshness.** Scores decay with every push. Webhook-driven rescoring is roadmap.
66
68
@@ -82,14 +84,14 @@ Short answer: **low risk**. The app:
82
84
- Rate limiting the public API.
83
85
- Sandbox the cloner in a container (future-proofing against hypothetical git CVEs).
84
86
85
-
Auth and per-maintainer controls land with the opt-out / claim flow in v0.4.0.
87
+
Auth and per-maintainer controls land with the opt-out / claim flow in v0.6.0.
86
88
87
89
## Quickstart
88
90
89
91
```bash
90
92
bun install
91
93
bun run prepare-hooks # once — installs lefthook pre-commit (Biome + tsc + test + file-length)
92
-
bun run seed # score the curated set (155 repos) across GH / GL / BB
94
+
bun run seed # score the curated set across GH / GL / BB
93
95
bun run dev # http://localhost:3000
94
96
```
95
97
@@ -108,7 +110,7 @@ Run the unit tests with `bun run test` (uses `node --test` + `tsx`; requires Nod
108
110
109
111
## Versioning
110
112
111
-
`lib/version.ts` and `package.json` carry the current release number (currently **0.2.0**). Bumps happen only when we actually cut a release — never when merging intermediate work. The version pill in the header surfaces the number directly; `/changelog` lists what each release shipped.
113
+
`lib/version.ts` and `package.json` carry the current release number (currently **0.3.0**). Bumps happen only when we actually cut a release — never when merging intermediate work. The version pill in the header surfaces the number directly; `/changelog` lists what each release shipped.
112
114
113
115
## Stack & rationale
114
116
@@ -169,13 +171,12 @@ LICENSE MIT
169
171
170
172
See `/roadmap` in the running app or the per-version `tasks/` folders for the full picture.
171
173
172
-
-**0.3.0 — real per-model weights**: benchmark harness actually runs agents on scoped tasks per repo; current illustrative weights get replaced with measured ones.
173
-
-**0.4.0 — ecosystem integration**: badge endpoint for READMEs, GitHub Action that comments score delta on PRs, webhook-driven rescoring, OAuth-gated opt-out / claim flow for maintainers.
174
-
-**0.5.0 — alternative recommender**: "repo Y does the same thing and ranks higher for your model."
-**0.7.0 — history-aware signals**: extend the scorer with maintenance recency, commit velocity, and contributor activity — closing the gap that the shallow clone leaves today.
177
-
-**1.0.0 — production stability**: Postgres migration for concurrent writers; from here on, breaking API changes require a MAJOR bump.
178
-
-**1.1.0 — at-scale GitHub indexing**: flip from a curated seed list to an auto-discovered crawl (GitHub search + trending + submissions). Target 10k repos on first delivery.
174
+
Versions are sequenced cheap-first so the highest-impact small additions don't get gated on heavy infra:
175
+
176
+
-**0.4.0 — quick wins**: history-aware signals (maintenance recency, commit velocity, contributor activity) + a GitHub Action that comments the score delta on every PR. No new infra.
177
+
-**0.5.0 — auto-refresh + smarter matching**: webhook-driven rescoring (keep scores fresh on every push) + alternatives via README embeddings (cross-language matches the v0.3.0 SQL heuristic misses).
178
+
-**0.6.0 — maintainer ownership + at-scale discovery**: OAuth opt-out / claim flow for maintainers + at-scale package overlay (per-registry leaderboards + userscript that renders the badge inline on npmjs.com / PyPI / crates.io).
179
+
-**1.0.0 — production cut**: Postgres migration for concurrent writers + auto-discovered crawl (target 10k repos) + benchmark harness that derives per-model weights from measured agent success. From here on, breaking API changes require a MAJOR bump.
179
180
180
181
## Defensibility
181
182
@@ -188,3 +189,7 @@ MIT — see [LICENSE](./LICENSE).
188
189
## Contributing
189
190
190
191
See [CONTRIBUTING.md](./CONTRIBUTING.md) for setup, branch/commit style, the PR description template, and the changelog discipline.
192
+
193
+
## Sponsor
194
+
195
+
If this project is useful to you, consider sponsoring its development: [github.com/sponsors/hsnice16](https://github.com/sponsors/hsnice16).
0 commit comments