Skip to content

Commit a9864dc

Browse files
TimDettmersclaude
TimDettmers
and
claude
committed
Update cached benchmark results (RTX 4090)
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent d66cb02 commit a9864dc

File tree

4 files changed

+164
-289
lines changed

4 files changed

+164
-289
lines changed

‎benchmarks/.bench_results/cublas.txt‎

Lines changed: 21 additions & 42 deletions
Original file line numberDiff line numberDiff line change
@@ -1,47 +1,26 @@
11
shape M avg_us
22
---
3-
gateup 1 23.09
4-
gateup 2 12.78
5-
gateup 3 13.08
6-
gateup 4 12.39
7-
gateup 8 14.66
8-
gateup 16 12.92
9-
down 1 17.89
10-
down 2 16.20
11-
down 3 17.88
12-
down 4 18.12
13-
down 8 36.33
14-
down 16 37.17
15-
Q 1 20.51
16-
Q 2 13.61
17-
Q 3 12.52
18-
Q 4 18.39
19-
Q 8 13.19
20-
Q 16 12.77
21-
O 1 14.80
22-
O 2 15.87
23-
O 3 16.78
24-
O 4 26.99
25-
O 8 30.40
26-
O 16 29.15
27-
KV 1 13.81
28-
KV 2 16.39
29-
KV 3 16.20
30-
KV 4 16.68
31-
KV 8 18.46
32-
KV 16 15.81
3+
gateup 1 20.87
4+
gateup 2 14.70
5+
gateup 4 14.33
6+
down 1 19.19
7+
down 2 17.94
8+
down 4 18.08
9+
Q 1 11.50
10+
Q 2 13.62
11+
Q 4 20.27
12+
O 1 15.72
13+
O 2 16.77
14+
O 4 29.05
15+
KV 1 11.83
16+
KV 2 17.62
17+
KV 4 18.69
3318

3419
shape M nexp avg_us
3520
---
36-
moe_gu 1 8 13.83
37-
moe_gu 2 8 13.19
38-
moe_gu 3 8 14.03
39-
moe_gu 4 8 12.62
40-
moe_gu 8 8 12.54
41-
moe_gu 16 8 12.57
42-
moe_dn 1 8 14.78
43-
moe_dn 2 8 13.09
44-
moe_dn 3 8 12.26
45-
moe_dn 4 8 15.24
46-
moe_dn 8 8 12.67
47-
moe_dn 16 8 12.95
21+
moe_gu 1 8 12.90
22+
moe_gu 2 8 13.89
23+
moe_gu 4 8 14.46
24+
moe_dn 1 8 12.88
25+
moe_dn 2 8 12.94
26+
moe_dn 4 8 12.99

‎benchmarks/.bench_results/grouped_mma.txt‎

Lines changed: 24 additions & 48 deletions
Original file line numberDiff line numberDiff line change
@@ -1,48 +1,24 @@
1-
moe_gu 2 1 9.04
2-
moe_gu 2 2 9.15
3-
moe_gu 2 3 9.34
4-
moe_gu 2 4 9.40
5-
moe_gu 2 8 10.13
6-
moe_gu 2 16 12.83
7-
moe_gu 3 1 10.48
8-
moe_gu 3 2 10.53
9-
moe_gu 3 3 10.81
10-
moe_gu 3 4 10.80
11-
moe_gu 3 8 11.45
12-
moe_gu 3 16 13.77
13-
moe_gu 4 1 11.72
14-
moe_gu 4 2 11.84
15-
moe_gu 4 3 11.95
16-
moe_gu 4 4 11.99
17-
moe_gu 4 8 12.45
18-
moe_gu 4 16 14.56
19-
moe_gu 5 1 13.00
20-
moe_gu 5 2 13.11
21-
moe_gu 5 3 13.23
22-
moe_gu 5 4 13.38
23-
moe_gu 5 8 13.69
24-
moe_gu 5 16 16.12
25-
moe_dn 2 1 9.18
26-
moe_dn 2 2 9.21
27-
moe_dn 2 3 9.42
28-
moe_dn 2 4 9.54
29-
moe_dn 2 8 9.91
30-
moe_dn 2 16 12.79
31-
moe_dn 3 1 10.67
32-
moe_dn 3 2 10.73
33-
moe_dn 3 3 10.98
34-
moe_dn 3 4 11.21
35-
moe_dn 3 8 11.45
36-
moe_dn 3 16 13.61
37-
moe_dn 4 1 11.91
38-
moe_dn 4 2 11.90
39-
moe_dn 4 3 12.44
40-
moe_dn 4 4 12.47
41-
moe_dn 4 8 12.66
42-
moe_dn 4 16 14.90
43-
moe_dn 5 1 13.15
44-
moe_dn 5 2 13.50
45-
moe_dn 5 3 13.40
46-
moe_dn 5 4 13.59
47-
moe_dn 5 8 13.96
48-
moe_dn 5 16 15.65
1+
moe_gu 2 1 10.09
2+
moe_gu 2 2 9.90
3+
moe_gu 2 4 10.17
4+
moe_gu 3 1 11.16
5+
moe_gu 3 2 11.14
6+
moe_gu 3 4 11.44
7+
moe_gu 4 1 12.68
8+
moe_gu 4 2 12.90
9+
moe_gu 4 4 12.99
10+
moe_gu 5 1 13.92
11+
moe_gu 5 2 14.12
12+
moe_gu 5 4 14.30
13+
moe_dn 2 1 9.96
14+
moe_dn 2 2 10.48
15+
moe_dn 2 4 10.46
16+
moe_dn 3 1 11.33
17+
moe_dn 3 2 11.29
18+
moe_dn 3 4 11.60
19+
moe_dn 4 1 12.94
20+
moe_dn 4 2 13.15
21+
moe_dn 4 4 13.28
22+
moe_dn 5 1 14.31
23+
moe_dn 5 2 14.20
24+
moe_dn 5 4 14.52

‎benchmarks/.bench_results/mma.txt‎

Lines changed: 60 additions & 120 deletions
Original file line numberDiff line numberDiff line change
@@ -1,120 +1,60 @@
1-
gateup 2 1 15.21
2-
gateup 2 2 15.43
3-
gateup 2 3 15.68
4-
gateup 2 4 15.82
5-
gateup 2 8 16.81
6-
gateup 2 16 19.64
7-
gateup 3 1 16.90
8-
gateup 3 2 16.96
9-
gateup 3 3 17.25
10-
gateup 3 4 17.39
11-
gateup 3 8 18.46
12-
gateup 3 16 20.65
13-
gateup 4 1 19.83
14-
gateup 4 2 19.96
15-
gateup 4 3 20.19
16-
gateup 4 4 20.30
17-
gateup 4 8 21.72
18-
gateup 4 16 23.71
19-
gateup 5 1 22.22
20-
gateup 5 2 22.40
21-
gateup 5 3 22.78
22-
gateup 5 4 22.92
23-
gateup 5 8 23.51
24-
gateup 5 16 25.74
25-
down 2 1 10.32
26-
down 2 2 10.36
27-
down 2 3 10.98
28-
down 2 4 11.07
29-
down 2 8 11.58
30-
down 2 16 14.58
31-
down 3 1 11.54
32-
down 3 2 11.73
33-
down 3 3 12.35
34-
down 3 4 12.40
35-
down 3 8 12.86
36-
down 3 16 15.40
37-
down 4 1 13.50
38-
down 4 2 13.55
39-
down 4 3 14.29
40-
down 4 4 14.26
41-
down 4 8 14.75
42-
down 4 16 17.17
43-
down 5 1 15.31
44-
down 5 2 15.36
45-
down 5 3 15.78
46-
down 5 4 15.82
47-
down 5 8 16.33
48-
down 5 16 18.92
49-
Q 2 1 8.91
50-
Q 2 2 9.04
51-
Q 2 3 9.28
52-
Q 2 4 9.60
53-
Q 2 8 10.38
54-
Q 2 16 13.87
55-
Q 3 1 10.08
56-
Q 3 2 10.22
57-
Q 3 3 10.35
58-
Q 3 4 10.63
59-
Q 3 8 11.37
60-
Q 3 16 14.43
61-
Q 4 1 11.67
62-
Q 4 2 11.64
63-
Q 4 3 11.97
64-
Q 4 4 12.45
65-
Q 4 8 13.00
66-
Q 4 16 15.57
67-
Q 5 1 13.12
68-
Q 5 2 13.36
69-
Q 5 3 13.49
70-
Q 5 4 13.65
71-
Q 5 8 14.29
72-
Q 5 16 17.26
73-
O 2 1 9.00
74-
O 2 2 9.06
75-
O 2 3 9.66
76-
O 2 4 9.75
77-
O 2 8 10.64
78-
O 2 16 13.40
79-
O 3 1 10.00
80-
O 3 2 10.11
81-
O 3 3 10.68
82-
O 3 4 10.72
83-
O 3 8 11.65
84-
O 3 16 14.25
85-
O 4 1 11.69
86-
O 4 2 11.82
87-
O 4 3 12.34
88-
O 4 4 12.44
89-
O 4 8 13.18
90-
O 4 16 15.83
91-
O 5 1 13.14
92-
O 5 2 13.29
93-
O 5 3 13.50
94-
O 5 4 13.60
95-
O 5 8 14.33
96-
O 5 16 16.93
97-
KV 2 1 5.04
98-
KV 2 2 5.14
99-
KV 2 3 6.22
100-
KV 2 4 5.60
101-
KV 2 8 6.69
102-
KV 2 16 9.41
103-
KV 3 1 5.23
104-
KV 3 2 5.32
105-
KV 3 3 6.37
106-
KV 3 4 5.60
107-
KV 3 8 6.69
108-
KV 3 16 9.46
109-
KV 4 1 5.67
110-
KV 4 2 5.72
111-
KV 4 3 6.82
112-
KV 4 4 5.95
113-
KV 4 8 7.18
114-
KV 4 16 9.95
115-
KV 5 1 5.71
116-
KV 5 2 5.92
117-
KV 5 3 6.90
118-
KV 5 4 6.23
119-
KV 5 8 7.32
120-
KV 5 16 10.12
1+
gateup 2 1 17.30
2+
gateup 2 2 17.25
3+
gateup 2 4 17.82
4+
gateup 3 1 19.55
5+
gateup 3 2 19.77
6+
gateup 3 4 20.23
7+
gateup 4 1 22.25
8+
gateup 4 2 22.67
9+
gateup 4 4 22.80
10+
gateup 5 1 25.64
11+
gateup 5 2 25.75
12+
gateup 5 4 26.09
13+
down 2 1 11.40
14+
down 2 2 11.44
15+
down 2 4 11.89
16+
down 3 1 13.01
17+
down 3 2 13.07
18+
down 3 4 13.60
19+
down 4 1 14.81
20+
down 4 2 14.80
21+
down 4 4 15.33
22+
down 5 1 17.47
23+
down 5 2 17.56
24+
down 5 4 17.59
25+
Q 2 1 9.93
26+
Q 2 2 9.95
27+
Q 2 4 10.40
28+
Q 3 1 11.28
29+
Q 3 2 11.39
30+
Q 3 4 11.78
31+
Q 4 1 12.68
32+
Q 4 2 12.77
33+
Q 4 4 13.31
34+
Q 5 1 14.76
35+
Q 5 2 15.05
36+
Q 5 4 15.30
37+
O 2 1 9.91
38+
O 2 2 9.90
39+
O 2 4 10.64
40+
O 3 1 11.18
41+
O 3 2 11.36
42+
O 3 4 12.04
43+
O 4 1 12.69
44+
O 4 2 12.72
45+
O 4 4 13.45
46+
O 5 1 14.78
47+
O 5 2 14.72
48+
O 5 4 15.30
49+
KV 2 1 5.26
50+
KV 2 2 5.21
51+
KV 2 4 6.43
52+
KV 3 1 5.34
53+
KV 3 2 5.49
54+
KV 3 4 6.63
55+
KV 4 1 5.75
56+
KV 4 2 5.77
57+
KV 4 4 7.03
58+
KV 5 1 5.97
59+
KV 5 2 6.07
60+
KV 5 4 7.30

0 commit comments

Comments
 (0)