3/3 Add harness-engineering-bench (GAIA + benchmarks) - #46

Merged

varunursekar merged 186 commits into

mainfrom

pr3-harness-bench

Jul 28, 2026

Commits on Jul 23, 2026

Add the redesigned VeRO system at the repository root
varunursekar
committed
harbor: baseline_floor off by default + pinnable baseline score (feedback #1)

varunursekar
and
claude
committed
harbor: score-baseline producer for pinnable baseline numbers (feedback #1)

varunursekar
and
claude
committed
tests: fix harbor build benchmark tests for the split + candidates flatten

varunursekar
and
claude
committed
harbor: k-anonymity floor defaults to 5, not a no-op (feedback #2)

varunursekar
and
claude
committed
harbor: pre-warm harness uv cache so isolation actually works

varunursekar
and
claude
committed
harbor: re-record n_dead_infra / n_clean in the mean aggregate (feedback #8)

varunursekar
and
claude
committed
address Greptile review on PR #45

varunursekar
and
claude
committed
docs: harbor benchmark architecture overview + review order

varunursekar
and
claude
committed
Bump harbor to 0.20.0; drop dead harness PYTHONPATH workaround

varunursekar
and
claude
committed
Fix harness isolation: grant traversal on the candidate checkout parent

varunursekar
and
claude
committed
Fail fast when the harness can't reach its workspace after provisioning

varunursekar
and
claude
committed
Add container integration test for harness-isolation invariants

varunursekar
and
claude
committed

Commits on Jul 24, 2026

Commits on Jul 25, 2026

Commits on Jul 26, 2026

Commits on Jul 27, 2026

Commits on Jul 28, 2026