|
1 | 1 | title: Introducing Training Arenas |
2 | 2 | date: 2026-01-07 |
3 | | -description: Ten new arenas, train models that are better competitive developers! |
| 3 | +description: Nine new arenas, train models that are better long-running developers! |
4 | 4 | authors: Muhtasham Oblokulov, Aryan Siddiqui, John Yang |
5 | 5 |
|
6 | 6 | Since CodeClash's release, our top priority has been enabling practitioners to improve models as CodeClash competitors and ultimately, long-running, autonomous software developers. |
7 | 7 |
|
8 | | -As an initial step of this effort, we've released an initial set of **10** arenas that we're designating as the official "**train**" split of CodeClash. |
| 8 | +As an initial step, we're releasing an initial set of **9** arenas that we're designating as the official "**train**" split of CodeClash (**CC:Train**). |
9 | 9 |
|
10 | 10 | - [Bridge](/arenas/bridge/) |
11 | 11 | - [Chess](/arenas/chess/) |
12 | 12 | - [Figgie](/arenas/figgie/) |
13 | 13 | - [Gomoku](/arenas/gomoku/) |
14 | 14 | - [Halite II](/arenas/halite2/) |
15 | | -- [Halite III](/arenas/halite2/) |
16 | | -- [MIT BattleCode 2024](/arenas/battlecode24) |
| 15 | +- [Halite III](/arenas/halite3/) |
| 16 | +- [MIT BattleCode 2023](/arenas/battlecode23/) |
| 17 | +- [MIT BattleCode 2024](/arenas/battlecode24/) |
17 | 18 | - [MIT BattleCode 2025](/arenas/battlecode25/) |
18 | 19 |
|
| 20 | +<div style="display:flex; gap:12px; justify-content:center;"> |
| 21 | + <img src="/static/images/arenas/bridge.gif" alt="Arena 1" style="width:33%; height:auto; object-fit:cover;" /> |
| 22 | + <img src="/static/images/arenas/chess.gif" alt="Arena 2" style="width:33%; height:auto; object-fit:cover;" /> |
| 23 | + <img src="/static/images/arenas/figgie.gif" alt="Arena 3" style="width:33%; height:auto; object-fit:cover;" /> |
| 24 | +</div> |
| 25 | +<div style="margin-top:0.5em; display:flex; gap:12px; justify-content:center;"> |
| 26 | + <img src="/static/images/arenas/gomoku.gif" alt="Arena 1" style="width:33%; height:auto; object-fit:cover;" /> |
| 27 | + <img src="/static/images/arenas/halite2.gif" alt="Arena 2" style="width:33%; height:auto; object-fit:cover;" /> |
| 28 | + <img src="/static/images/arenas/halite3.gif" alt="Arena 3" style="width:33%; height:auto; object-fit:cover;" /> |
| 29 | +</div> |
| 30 | +<div style="margin-top:0.5em; display:flex; gap:12px; justify-content:center;"> |
| 31 | + <img src="/static/images/arenas/battlecode24.gif" alt="Arena 1" style="width:33%; height:auto; object-fit:cover;" /> |
| 32 | + <img src="/static/images/arenas/battlecode24.gif" alt="Arena 2" style="width:33%; height:auto; object-fit:cover;" /> |
| 33 | + <img src="/static/images/arenas/battlecode25.gif" alt="Arena 3" style="width:33%; height:auto; object-fit:cover;" /> |
| 34 | +</div> |
| 35 | +<div style="margin-top:0.5em; text-align:center;"> |
| 36 | + <span class="subtext">Introducing 9 new training arenas for CodeClash!</span> |
| 37 | +</div> |
| 38 | + |
| 39 | +**CC:Train** arenas span a range of properties, including: |
| 40 | + |
| 41 | +- Perfect (Chess) vs. Imperfect Information (Bridge) |
| 42 | +- Classical board games (Gomoku) vs. Custom competition formats (BattleCode) |
| 43 | +- Head-to-head (Chess, Gomoku, BattleCode) vs. Multi-player (Figgie, Gomoku, Halite) |
| 44 | + |
| 45 | +Today's models are mainly trained with tasks that use unit tests as verification (e.g., [SWE-bench](http://swebench.com/), [SWE-smith](https://swesmith.com/)). |
| 46 | + |
| 47 | +We are curious if coding capabilities could improve by post-training on open-ended, competitive objectives. |
| 48 | +Some ideas: |
| 49 | + |
| 50 | +- Self play RL with competition outcomes as rewards |
| 51 | +- Transferability. |
| 52 | + - Training on Halite II/III may likely lead to better performance on Halite I, but what about Gomoku? |
| 53 | + - Does training on open-ended code tasks (e.g., CodeClash, improving runtime [[1](https://swefficiency.com/), [2](https://swe-perf.github.io/), [3](https://gso-bench.github.io/)]) improve performance on in/out-of-distribution coding benchmarks? |
| 54 | +- Mitigating [code slop and bad development practices](https://x.com/jyangballin/status/1986093913455968387) (e.g., single use scripts, redundant code, poor organization) |
0 commit comments