You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs(benchmark): re-run opus/fable/spark on the retry-improved bridge
After adding the no-tool-call recovery retry to the cli-agents bridge, re-ran the models most affected by
prose-instead-of-tool-call losses. Suite scores recovered: claude-opus-4.8 79.7 → 83.2, claude-fable-5
78.9 → 81.4, gpt-5.3-spark 91.0 → 92.9. Updated the root README top-tier table, the benchmark guide, the
community leaderboard, the comparison chart, and added a bridge note that sol/terra/gpt-5.5/luna/sonnet
predate the fix.
Copy file name to clipboardExpand all lines: README.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -95,12 +95,12 @@ CoreAI ships a game-creation benchmark: it scores how well an LLM builds and cha
95
95
|---:|---|---:|---:|
96
96
| 1 |`gpt-5.6-sol`|**96.6**| 85.7% |
97
97
| 2 |`gpt-5.6-terra`|**93.0**| 86.2% |
98
-
| 3 |`gpt-5.3-spark`|**91.0**|82.8% |
98
+
| 3 |`gpt-5.3-spark`|**92.9**|79.3% |
99
99
| 4 |`gpt-5.5`|**90.3**| 82.8% |
100
100
| 5 |`gpt-5.6-luna`|**88.1**| 79.3% |
101
101
| 6 |`claude-sonnet-5`|**86.2**| 75.9% |
102
-
| 7 |`claude-opus-4.8`|**79.7**|75.9% |
103
-
| 8 |`claude-fable-5`|**78.9**|72.4% |
102
+
| 7 |`claude-opus-4.8`|**83.2**|79.3% |
103
+
| 8 |`claude-fable-5`|**81.4**|75.9% |
104
104
105
105
One run each via the `cli-agents` bridge (indicative). The Claude rows are held back by a high bridge tool-failure rate, not raw capability — details in the guide. Full tables (v2 + historical + local), methodology, group legend and the per-model castle prefabs: **[benchmark guide](Assets/CoreAIBenchmark/README.md)** · **[leaderboard](Docs/BENCHMARK_LEADERBOARD.md)**.
0 commit comments