Skip to content

Commit e403abe

Browse files
committed
Enhance majority voting plugin and update eval config
Upgrades the majority voting plugin with category-aware answer extraction, adaptive temperature control, improved normalization, response quality filtering, and smart fallback strategies. Updates the default test-time compute configuration in eval_optillmbench.py to use 5 candidates instead of 8 for fairer comparison and memory efficiency, and revises related reporting logic and documentation.
1 parent a2cd56c commit e403abe

2 files changed

Lines changed: 335 additions & 206 deletions

File tree

0 commit comments

Comments
 (0)