Skip to content

Commit f0c3d87

Browse files
john-b-yangjohn-b-yang
committed
WIP push
1 parent c15055a commit f0c3d87

14 files changed

Lines changed: 386 additions & 276 deletions

File tree

‎pages/insights/20251103_release.md‎

Lines changed: 4 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -3,19 +3,9 @@ date: 2025-11-03
33
description: Benchmarking Goal Oriented Software Engineering
44
authors: John Yang, Kilian Lieret
55

6-
<img src="/static/images/insights/20251104_release/banner.png" class="img-insight" />
7-
6+
Existing coding benchmarks evaluate Language Models (LMs) on *tasks*.
87

8+
By "task", we're referring to implementation requests with well-defined input-output specifications.
9+
For instance, here's
910

10-
<div style="display:flex;justify-content:center;">
11-
<div style="position:relative;padding-bottom:50%;height:0;overflow:hidden;width:80%;max-width:800px;">
12-
<iframe
13-
style="position:absolute;top:0;left:0;width:100%;height:100%;"
14-
src="https://www.youtube.com/embed/gqud6kAP1us?si=todoCO-pSDlX4HjK"
15-
title="YouTube video player"
16-
frameborder="0"
17-
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
18-
referrerpolicy="strict-origin-when-cross-origin" allowfullscreen>
19-
</iframe>
20-
</div>
21-
</div>
11+
<img src="/static/images/insights/20251104_release/banner.png" class="img-insight" />

‎static/css/core.css‎

Lines changed: 38 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,10 @@
66
* Design tokens and CSS variables
77
*/
88
:root {
9-
/* Colors */
9+
--bg: #ffffff;
10+
--fg: #0b0b0b;
11+
--border: #e5e7eb;
12+
--accent: #00cc66;
1013
--gray: #6b7280;
1114

1215
/* Layout */
@@ -16,7 +19,7 @@
1619
--font-primary: 'Inter', -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Helvetica, Arial, sans-serif;
1720
--font-jersey: 'Jersey', serif;
1821

19-
/* Font sizes */
22+
/* Font sizes */
2023
--text-xs: 0.75rem; /* 12px */
2124
--text-sm: 0.875rem; /* 14px */
2225
--text-base: 1rem; /* 16px */
@@ -31,6 +34,39 @@
3134
--weight-medium: 500;
3235
--weight-semibold: 600;
3336
--weight-bold: 700;
37+
38+
/* Box shadows */
39+
--box-shadow: rgba(0, 0, 0, 0.1);
40+
}
41+
42+
@media (prefers-color-scheme: dark) {
43+
:root {
44+
--bg: #0b0c0c;
45+
--fg: #e7e9ea;
46+
--muted: #9aa2a9;
47+
--border: #1f2328;
48+
--accent: #00ff88;
49+
}
50+
}
51+
52+
:root[data-theme="light"] {
53+
--bg: #ffffff;
54+
--fg: #0b0b0b;
55+
--muted: #5a5f66;
56+
--border: #e5e7eb;
57+
--accent: #00cc66;
58+
--box-shadow: rgba(0, 0, 0, 0.1);
59+
--gray: #6b7280;
60+
}
61+
62+
:root[data-theme="dark"] {
63+
--bg: #0b0c0c;
64+
--fg: #e7e9ea;
65+
--muted: #9aa2a9;
66+
--border: #1f2328;
67+
--accent: #00ff88;
68+
--box-shadow: rgba(255, 255, 255, 0.15);
69+
--gray: #6b7280;
3470
}
3571

3672
.jersey { font-family: var(--font-jersey); }

‎static/css/homepage.css‎

Lines changed: 63 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,63 @@
1+
.htitle {
2+
font-size: var(--text-3xl);
3+
font-weight: var(--weight-bold);
4+
margin: 0;
5+
}
6+
7+
.hsubtext {
8+
font-size: var(--text-md);
9+
color: var(--muted);
10+
margin: 0.5em 0 1em 0;
11+
}
12+
13+
.hsubtitle{
14+
font-size: var(--text-xl);
15+
color: var(--muted);
16+
margin: 0.5em 0;
17+
}
18+
19+
.h2columns {
20+
display: grid;
21+
grid-template-columns: 60% 40%;
22+
gap: 2rem;
23+
margin-top: 0;
24+
}
25+
26+
.h3columns {
27+
display: grid;
28+
grid-template-columns: 33% 33% 33%;
29+
gap: 2rem;
30+
margin-top: 0;
31+
}
32+
33+
.hfeature {
34+
border: 1px solid var(--border);
35+
border-radius: 0.5rem;
36+
padding: 0.75rem 1rem;
37+
margin-bottom: 0.5rem;
38+
}
39+
40+
.hfeature span {
41+
font-size: var(--text-md);
42+
font-weight: var(--weight-bold);
43+
}
44+
45+
.hfeature svg {
46+
height: 1rem;
47+
width: 1rem;
48+
vertical-align: middle;
49+
margin-right: 0.1em;
50+
display: inline-block;
51+
transform: translateY(-0.12em);
52+
color: var(--accent);
53+
}
54+
55+
.hfeature p {
56+
margin: 0.5em 0 0 0;
57+
font-size: var(--text-sm);
58+
}
59+
60+
.hthesis {
61+
width: 70%;
62+
margin: 0 auto;
63+
}

‎static/css/layout.css‎

Lines changed: 14 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,8 @@
22
html, body {
33
font-family: var(--font-primary);
44
font-size: var(--text-base);
5+
background: var(--bg);
6+
color: var(--fg);
57
}
68

79
body {
@@ -10,9 +12,7 @@ body {
1012
margin: 0 auto;
1113
}
1214

13-
.container {
14-
margin-bottom: 2em;
15-
}
15+
.container { margin-bottom: 2em; }
1616

1717
.img-insight {
1818
width: 80%;
@@ -34,11 +34,14 @@ body {
3434
}
3535

3636
/* Top Navigation Bar */
37-
.nav-container {
37+
nav {
3838
display: flex;
3939
align-items: center;
4040
justify-content: space-between;
4141
margin: 0 1rem;
42+
border-bottom: 1px solid var(--border);
43+
top: 0;
44+
background-color: var(--bg);
4245
}
4346

4447
.nav-left {
@@ -50,7 +53,7 @@ body {
5053
.nav-links {
5154
display: flex;
5255
list-style: none;
53-
gap: 1rem;
56+
gap: 0.5rem;
5457
}
5558

5659
.nav-links li {
@@ -170,7 +173,7 @@ body {
170173
align-items: center;
171174
justify-content: center;
172175
text-align: center;
173-
box-shadow: 0 2px 8px rgba(0, 0, 0, 0.1);
176+
box-shadow: 0 2px 8px var(--box-shadow);
174177
transition: transform 0.2s, box-shadow 0.2s;
175178
}
176179

@@ -222,11 +225,11 @@ body {
222225
.team-card {
223226
display: block;
224227
padding: 1.5rem;
225-
border: 1px solid #e5e7eb;
228+
border: 1px solid var(--border);
226229
text-decoration: none;
227230
color: inherit;
228231
cursor: pointer;
229-
background-color: white;
232+
background-color: var(--bg);
230233
}
231234

232235
.team-card:hover {
@@ -249,13 +252,14 @@ body {
249252

250253
/* Code blocks */
251254
pre {
252-
background-color: #f6f8fa;
253-
border: 1px solid #e1e4e8;
255+
background-color: var(--bg);
256+
border: 1px solid var(--border);
254257
border-radius: 0.5em;
255258
padding: 1rem;
256259
overflow-x: auto;
257260
font-size: var(--text-sm);
258261
line-height: 1.5;
262+
color: var(--fg);
259263
}
260264

261265
pre p {

‎static/css/main.css‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,4 @@
11
/* Main CSS - Importing new theme system */
2-
@import 'theme.css';
2+
@import 'core.css';
3+
@import 'layout.css';
4+
@import 'homepage.css';

‎templates/_leaderboard.html‎

Lines changed: 24 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,21 +1,38 @@
1-
<table>
1+
<table class="leaderboard-table">
22
<thead>
33
<tr>
44
<th>Rank</th>
55
<th>Model</th>
6-
<th style="text-align: right;">ELO</th>
6+
<th>ELO</th>
77
</tr>
88
</thead>
99
<tbody>
1010
{% for entry in leaderboard.board %}
11-
<tr{% if entry.rank <= 3 %} class="top-three"{% endif %}>
12-
<td class="rank-cell">{{ entry.rank }}</td>
13-
<td class="model-cell">{{ entry.model }}</td>
14-
<td class="elo-cell">{{ entry.elo }}</td>
11+
<tr>
12+
<td>{{ entry.rank }}</td>
13+
<td>
14+
{% set logos = {
15+
'GPT-5': '/static/images/orgs/openai.svg',
16+
'GPT-5 Mini': '/static/images/orgs/openai.svg',
17+
'o3': '/static/images/orgs/openai.svg',
18+
'Claude Sonnet 4.5': '/static/images/orgs/anthropic.svg',
19+
'Claude Sonnet 4': '/static/images/orgs/anthropic.svg',
20+
'Gemini 2.5 Pro': '/static/images/orgs/google.svg',
21+
'Grok Code Fast': '/static/images/orgs/xai.svg',
22+
'Qwen3 Coder': '/static/images/orgs/qwen.png',
23+
} %}
24+
<img
25+
src="{{ logos.get(entry.model, '/static/images/orgs/default.svg') }}"
26+
alt="{{ entry.model }} logo"
27+
style="height:1em; vertical-align:middle; margin-right:0.4em; display:inline-block; transform:translateY(-0.12em);"
28+
/>
29+
{{ entry.model }}
30+
</td>
31+
<td>{{ entry.elo }} ± {{ entry.elo_std }}</td>
1532
</tr>
1633
{% endfor %}
1734
</tbody>
1835
</table>
19-
<p style="padding: 12px 14px; margin: 0;">
36+
<p>
2037
<span class="subtext">Last updated</span> {{ leaderboard.last_updated | format_timestamp }}
2138
</p>

‎templates/_topnav.html‎

Lines changed: 18 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,20 @@
11
<nav>
2-
<a href="/" class="nav-logo">CodeClash</a>
3-
<ul class="nav-links">
4-
<li><a href="/#about">About</a></li>
5-
<li><a href="/arenas/">Arenas</a></li>
6-
<li><a href="">Docs</a></li>
7-
<li><a href="/insights/">Insights</a></li>
8-
<li><a href="/team/">Team</a></li>
9-
</ul>
2+
<div class="nav-left">
3+
<a href="/">
4+
<span>CodeClash</span>
5+
</a>
6+
</div>
7+
<div class="nav-right">
8+
<ul class="nav-links">
9+
<a href="/arenas/"><li>Arenas</li></a>
10+
<a href=""><li>Docs</li></a>
11+
<a href="/insights/"><li>Insights</li></a>
12+
<a href="/team/"><li>Team</li></a>
13+
</ul>
14+
<button
15+
id="theme-toggle"
16+
class="theme-toggle"
17+
aria-label="Toggle theme"
18+
>THEME</button>
19+
</div>
1020
</nav>

0 commit comments

Comments
 (0)