Benchmark validity: close the 3 audit-flagged holes (sense-leak + 2 factsCore gaming surfaces)#121

Merged

anantham merged 18 commits into

mainfrom

fix/opus-benchmark-validity

Jul 19, 2026

Commits on Jul 16, 2026

Review #5: exclude agent worktrees (.claude/**) from vitest discovery

anantham
and
claude
committed
Review #1: dedupe illustration markers so a duplicate can't double-bill

anantham
and
claude
committed
Review #4: release the pending claim when a budget preflight throws

anantham
and
claude
committed
Review #2: make the budget gate count billed-but-unpersisted spend

anantham
and
claude
committed
Review #3: actually cancel Claude and Gemini on a timeout/abort

anantham
and
claude
committed
Bench validity #5: correct the board's grounding / closed-book provenance

anantham
and
claude
committed
Bench validity #2 + #6: de-leak the ranked phases, add a fail-closed budget cap

anantham
and
claude
committed
Bench validity #4: make the facts scorer rank-ready — un-gameable morph + vocab

anantham
and
claude
committed
Bench validity #1 (draft): repair the golden/prompt contract — 16 mechanical fixes + gate

anantham
and
claude
committed
Bench validity #1 Part 2: reconcile the sandhi/omission goldens (one-word-per-token)

anantham
and
claude
committed
Bench validity: implement the v2.2 ranked formula (40/30/30 final-score weights)

anantham
and
claude
committed

Commits on Jul 18, 2026