feat(metrics): consolidate gpt-oss/deepseek accuracy, dedup reporting, surface TPS#400

Merged

arekay-nv merged 31 commits into

mainfrom

arekay/feat-consolidate-accuracy-reporting

Jul 14, 2026

Commits on Jul 9, 2026

feat(accuracy): consolidate gpt-oss/deepseek accuracy reporting

arekay-nv
and
claude
committed

Commits on Jul 10, 2026

feat(accuracy): per-dataset accuracy list on Report and results.json

arekay-nv
and
claude
committed
refactor(accuracy): find_accuracy_breakdown reads the per-dataset list

arekay-nv
and
claude
committed
refactor(accuracy): remove gpt-oss-120b composite dataset and scorer

arekay-nv
and
claude
committed
fix(accuracy): update publish_submission + bfcl multi-turn CLI to the accuracy list shape

arekay-nv
and
claude
committed
fix(accuracy): coerce numpy scalar scores to native float for serialization

arekay-nv
and
claude
committed
fix(ci): mypy-clean score coercion + integration test list shape

arekay-nv
and
claude
committed
Merge branch 'main' into arekay/feat-consolidate-accuracy-reporting
arekay-nv
authored
feat(accuracy): add per-accuracy-phase duration to report entries

arekay-nv
and
claude
committed
feat(accuracy): write accuracy_results.json to a dedicated accuracy/ folder

arekay-nv
and
claude
committed
refactor(report): move result_summary.json under a performance/ folder

arekay-nv
and
claude
committed
refactor(report): conform report layout to mlcommons/inference#2628

arekay-nv
and
claude
committed
refactor(report): keep result_summary.json name; drop accuracy from it

arekay-nv
and
claude
committed
feat(accuracy): add accuracy_config.scale to report scores on any scale

arekay-nv
and
claude
committed

Commits on Jul 11, 2026

Commits on Jul 12, 2026

test(accuracy): single import style in test_score_accuracy

arekay-nv
and
claude
committed

Commits on Jul 14, 2026