Skip to content

Commit ff2c88e

Browse files
LoCoBench Botclaude
LoCoBench Bot
and
claude
committed
feat: US-004 - Archive saturated ccb_repoqa benchmark
ccb_repoqa scores 1.000/1.000 on both baseline and SG_full configs, providing zero discriminative signal. Archive for reference; harder variant planned. - Move benchmarks/ccb_repoqa/ → benchmarks/archive/ccb_repoqa/ - Move configs/repoqa_2config.sh → configs/archive/repoqa_2config.sh - Remove 10 repoqa entries from selected_benchmark_tasks.json - Update benchmarks/README.md (remove from active, add archived section) - Recalculate metadata totals in selected_benchmark_tasks.json Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 9b3a823 commit ff2c88e

72 files changed

Lines changed: 34 additions & 212 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎benchmarks/README.md‎

Lines changed: 13 additions & 15 deletions

benchmarks/ccb_repoqa/MANIFEST.json renamed to benchmarks/archive/ccb_repoqa/MANIFEST.json

File renamed without changes.

benchmarks/ccb_repoqa/data/repoqa_instances.jsonl renamed to benchmarks/archive/ccb_repoqa/data/repoqa_instances.jsonl

File renamed without changes.

benchmarks/ccb_repoqa/generate_tasks.py renamed to benchmarks/archive/ccb_repoqa/generate_tasks.py

File renamed without changes.

benchmarks/ccb_repoqa/selected_tasks.json renamed to benchmarks/archive/ccb_repoqa/selected_tasks.json

File renamed without changes.

benchmarks/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/environment/Dockerfile renamed to benchmarks/archive/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/environment/Dockerfile

File renamed without changes.

benchmarks/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/instruction.md renamed to benchmarks/archive/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/instruction.md

benchmarks/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/task.toml renamed to benchmarks/archive/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/task.toml

File renamed without changes.

benchmarks/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/tests/ground_truth.json renamed to benchmarks/archive/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/tests/ground_truth.json

File renamed without changes.

benchmarks/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/tests/test.sh renamed to benchmarks/archive/ccb_repoqa/tasks/repoqa-cpp-apache-logging-log4cxx-03/tests/test.sh

File renamed without changes.

0 commit comments

Comments
 (0)