Centralize shared utilities across benchmark backends#2040

Draft

jnke2016 wants to merge 16 commits intorapidsai:mainfrom

jnke2016:consolidate-shared-utils

Commits on Apr 26, 2026

Refactor Dataset from dataclass to regular class with transparent vector loading from file paths on first access
jnke2016
committed
Add dtype_from_filename from generate_groundtruth/utils.py and refactor load_vectors to use it.
jnke2016
committed
Fix outdated DummyBackend/AnotherDummyBackend signatures in test_registry.py to match current BenchmarkBackend abstract interface
jnke2016
committed
Add test_utils.py with tests for shared backend utilities, Dataset transparent vector loading, and base ConfigLoader inherited methods
jnke2016
committed
Refactor ConfigLoader.load() to handle shared steps (YAML loading, dataset lookup, DatasetConfig construction) and delegate backend-specific logic to abstract _build_benchmark_configs().
jnke2016
committed

Commits on Apr 28, 2026

Move recall computation from backends to orchestrator, computed transparently after backend.search() returns
jnke2016
committed