Commit e403abe
committed
Enhance majority voting plugin and update eval config
Upgrades the majority voting plugin with category-aware answer extraction, adaptive temperature control, improved normalization, response quality filtering, and smart fallback strategies. Updates the default test-time compute configuration in eval_optillmbench.py to use 5 candidates instead of 8 for fairer comparison and memory efficiency, and revises related reporting logic and documentation.1 parent a2cd56c commit e403abe
2 files changed
Lines changed: 335 additions & 206 deletions
0 commit comments