You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
benchmark: add --agent hermes support + first comparison results
AIEB v1.0 now supports --agent odek|hermes.
First head-to-head (deepseek-v4-flash):
odek: 199s, 90%, 208K tokens
hermes: 273s, 92%, N/A
Hermes is 2pp more accurate but 37% slower — richer system
prompt + memory overhead per invocation. Odek wins on
trivial tasks (5s vs 31s), Hermes wins on refactoring.
0 commit comments