Skip to content

Commit 7ed2962

Browse files
mlcommons-botmlcommons-bot
committed
Results from R50 GH action on ubuntu-latest
1 parent 126cc0c commit 7ed2962

11 files changed

Lines changed: 260 additions & 259 deletions

File tree

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 21.293 | - |
3+
| resnet50 | offline | 76 | 36.429 | - |

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/README.md‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55
* OS version: Linux-6.17.0-1010-azure-x86_64-with-glibc2.39
66
* CPU version: x86_64
7-
* Python version: 3.12.13 (main, Mar 4 2026, 02:26:36) [GCC 13.3.0]
7+
* Python version: 3.13.13 (main, Apr 8 2026, 02:25:29) [GCC 13.3.0]
88
* MLC version: unknown
99

1010
## MLC Run Command
@@ -16,7 +16,7 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo GATEOverflow@mlperf-automations --checkout=9c2f85db548254d709ca80cd7474932d26ee27d5
19+
mlc pull repo GATEOverflow@mlperf-automations --checkout=ea28ebff1d8d9fe71c37d68122d18e42eafdb1d1
2020

2121

2222
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `21.2926`
43+
`Samples per second`: `36.4292`

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy/accuracy.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
accuracy=76.000%, good=380, total=500
22

3-
hash=79feae106e82c9012a6572f4f82453428bc4b5aba65ce10d99b19b3004ca3100
3+
hash=540f177183d4e378d5ac1a18ccdf65409cce5e61938936f6f3e9d8fc375ad7c0

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy/mlperf_log_accuracy.json‎

Lines changed: 66 additions & 66 deletions
Original file line numberDiff line numberDiff line change
@@ -31,74 +31,42 @@
3131
{ "seq_id" : 29, "qsl_idx" : 229, "data" : "E502000000000000" },
3232
{ "seq_id" : 30, "qsl_idx" : 6, "data" : "4E01000000000000" },
3333
{ "seq_id" : 31, "qsl_idx" : 348, "data" : "3003000000000000" },
34-
{ "seq_id" : 32, "qsl_idx" : 217, "data" : "4D00000000000000" },
35-
{ "seq_id" : 33, "qsl_idx" : 102, "data" : "6803000000000000" },
36-
{ "seq_id" : 34, "qsl_idx" : 216, "data" : "1000000000000000" },
37-
{ "seq_id" : 35, "qsl_idx" : 422, "data" : "B103000000000000" },
38-
{ "seq_id" : 36, "qsl_idx" : 17, "data" : "1700000000000000" },
39-
{ "seq_id" : 37, "qsl_idx" : 143, "data" : "D602000000000000" },
40-
{ "seq_id" : 38, "qsl_idx" : 262, "data" : "B000000000000000" },
41-
{ "seq_id" : 39, "qsl_idx" : 432, "data" : "EC02000000000000" },
42-
{ "seq_id" : 40, "qsl_idx" : 252, "data" : "8702000000000000" },
43-
{ "seq_id" : 41, "qsl_idx" : 160, "data" : "A800000000000000" },
44-
{ "seq_id" : 42, "qsl_idx" : 149, "data" : "D103000000000000" },
45-
{ "seq_id" : 43, "qsl_idx" : 402, "data" : "FE01000000000000" },
46-
{ "seq_id" : 44, "qsl_idx" : 230, "data" : "7D00000000000000" },
47-
{ "seq_id" : 45, "qsl_idx" : 447, "data" : "5202000000000000" },
48-
{ "seq_id" : 46, "qsl_idx" : 401, "data" : "6703000000000000" },
49-
{ "seq_id" : 47, "qsl_idx" : 330, "data" : "7E03000000000000" },
50-
{ "seq_id" : 48, "qsl_idx" : 308, "data" : "A603000000000000" },
51-
{ "seq_id" : 49, "qsl_idx" : 249, "data" : "7E03000000000000" },
52-
{ "seq_id" : 50, "qsl_idx" : 468, "data" : "B001000000000000" },
53-
{ "seq_id" : 51, "qsl_idx" : 266, "data" : "BF03000000000000" },
54-
{ "seq_id" : 52, "qsl_idx" : 158, "data" : "4302000000000000" },
55-
{ "seq_id" : 53, "qsl_idx" : 235, "data" : "7300000000000000" },
56-
{ "seq_id" : 54, "qsl_idx" : 374, "data" : "D000000000000000" },
57-
{ "seq_id" : 55, "qsl_idx" : 56, "data" : "9A00000000000000" },
58-
{ "seq_id" : 56, "qsl_idx" : 179, "data" : "E600000000000000" },
59-
{ "seq_id" : 57, "qsl_idx" : 111, "data" : "BA03000000000000" },
60-
{ "seq_id" : 58, "qsl_idx" : 163, "data" : "F801000000000000" },
61-
{ "seq_id" : 59, "qsl_idx" : 344, "data" : "E902000000000000" },
62-
{ "seq_id" : 60, "qsl_idx" : 14, "data" : "5302000000000000" },
63-
{ "seq_id" : 61, "qsl_idx" : 283, "data" : "7103000000000000" },
64-
{ "seq_id" : 62, "qsl_idx" : 484, "data" : "0502000000000000" },
65-
{ "seq_id" : 63, "qsl_id
34+
{ "seq_id" : 64, "qsl_idx" : 192, "data" : "C101000000000000" },
35+
{ "seq_id" : 65, "qsl_idx" : 211, "data" : "7903000000000000" },
36+
{ "seq_id" : 66, "qsl_idx" : 129, "data" : "1B01000000000000" },
37+
{ "seq_id" : 67, "qsl_idx" : 292, "data" : "8A01000000000000" },
38+
{ "seq_id" : 68, "qsl_idx" : 335, "data" : "CF01000000000000" },
39+
{ "seq_id" : 69, "qsl_idx" : 218, "data" : "6202000000000000" },
40+
{ "seq_id" : 70, "qsl_idx" : 190, "data" : "F300000000000000" },
41+
{ "seq_id" : 71, "qsl_idx" : 228, "data" : "2300000000000000" },
42+
{ "seq_id" : 72, "qsl_idx" : 378, "data" : "C700000000000000" },
43+
{ "seq_id" : 73, "qsl_idx" : 394, "data" : "4A00000000000000" },
44+
{ "seq_id" : 74, "qsl_idx" : 24, "data" : "1700000000000000" },
45+
{ "seq_id" : 75, "qsl_idx" : 285, "data" : "A003000000000000" },
46+
{ "seq_id" : 76, "qsl_idx" : 267, "data" : "9D01000000000000" },
47+
{ "seq_id" : 77, "qsl_idx" : 368, "data" : "E802000000000000" },
48+
{ "seq_id" : 78, "qsl_idx" : 454, "data" : "1403000000000000" },
49+
{ "seq_id" : 79, "qsl_idx" : 400, "data" : "6701000000000000" },
50+
{ "seq_id" : 80, "qsl_idx" : 185, "data" : "2101000000000000" },
51+
{ "seq_id" : 81, "qsl_idx" : 480, "data" : "8401000000000000" },
52+
{ "seq_id" : 82, "qsl_idx" : 18, "data" : "DE01000000000000" },
53+
{ "seq_id" : 83, "qsl_idx" : 382, "data" : "E400000000000000" },
54+
{ "seq_id" : 84, "qsl_idx" : 407, "data" : "E603000000000000" },
55+
{ "seq_id" : 85, "qsl_idx" : 443, "data" : "5E01000000000000" },
56+
{ "seq_id" : 86, "qsl_idx" : 282, "data" : "1B01000000000000" },
57+
{ "seq_id" : 87, "qsl_idx" : 92, "data" : "6E01000000000000" },
58+
{ "seq_id" : 88, "qsl_idx" : 59, "data" : "4C02000000000000" },
59+
{ "seq_id" : 89, "qsl_idx" : 35, "data" : "7703000000000000" },
60+
{ "seq_id" : 90, "qsl_idx" : 194, "data" : "7600000000000000" },
61+
{ "seq_id" : 91, "qsl_idx" : 418, "data" : "A902000000000000" },
62+
{ "seq_id" : 92, "qsl_idx" : 487, "data" : "F202000000000000" },
63+
{ "seq_id" : 93, "qsl_idx" : 389, "data" : "8500000000000000" },
64+
{ "seq_id" : 94, "qsl_idx" : 46, "data" : "3502000000000000" },
65+
{ "seq_id" : 95, "qsl_idx"
6666

6767
...
6868

69-
700000000000000" },
70-
{ "seq_id" : 438, "qsl_idx" : 52, "data" : "4C03000000000000" },
71-
{ "seq_id" : 439, "qsl_idx" : 434, "data" : "EC02000000000000" },
72-
{ "seq_id" : 440, "qsl_idx" : 114, "data" : "FD00000000000000" },
73-
{ "seq_id" : 441, "qsl_idx" : 65, "data" : "8601000000000000" },
74-
{ "seq_id" : 442, "qsl_idx" : 74, "data" : "5000000000000000" },
75-
{ "seq_id" : 443, "qsl_idx" : 241, "data" : "6E01000000000000" },
76-
{ "seq_id" : 444, "qsl_idx" : 318, "data" : "6600000000000000" },
77-
{ "seq_id" : 445, "qsl_idx" : 110, "data" : "7A00000000000000" },
78-
{ "seq_id" : 446, "qsl_idx" : 109, "data" : "4503000000000000" },
79-
{ "seq_id" : 447, "qsl_idx" : 478, "data" : "6B03000000000000" },
80-
{ "seq_id" : 448, "qsl_idx" : 31, "data" : "3D02000000000000" },
81-
{ "seq_id" : 449, "qsl_idx" : 268, "data" : "0101000000000000" },
82-
{ "seq_id" : 450, "qsl_idx" : 396, "data" : "5403000000000000" },
83-
{ "seq_id" : 451, "qsl_idx" : 458, "data" : "9E01000000000000" },
84-
{ "seq_id" : 452, "qsl_idx" : 240, "data" : "1402000000000000" },
85-
{ "seq_id" : 453, "qsl_idx" : 328, "data" : "0800000000000000" },
86-
{ "seq_id" : 454, "qsl_idx" : 81, "data" : "A000000000000000" },
87-
{ "seq_id" : 455, "qsl_idx" : 166, "data" : "0D03000000000000" },
88-
{ "seq_id" : 456, "qsl_idx" : 355, "data" : "8200000000000000" },
89-
{ "seq_id" : 457, "qsl_idx" : 203, "data" : "5102000000000000" },
90-
{ "seq_id" : 458, "qsl_idx" : 294, "data" : "E202000000000000" },
91-
{ "seq_id" : 459, "qsl_idx" : 380, "data" : "6F03000000000000" },
92-
{ "seq_id" : 460, "qsl_idx" : 93, "data" : "0C03000000000000" },
93-
{ "seq_id" : 461, "qsl_idx" : 263, "data" : "B602000000000000" },
94-
{ "seq_id" : 462, "qsl_idx" : 105, "data" : "8A03000000000000" },
95-
{ "seq_id" : 463, "qsl_idx" : 152, "data" : "2700000000000000" },
96-
{ "seq_id" : 464, "qsl_idx" : 239, "data" : "A601000000000000" },
97-
{ "seq_id" : 465, "qsl_idx" : 386, "data" : "9802000000000000" },
98-
{ "seq_id" : 466, "qsl_idx" : 51, "data" : "1D00000000000000" },
99-
{ "seq_id" : 467, "qsl_idx" : 136, "data" : "A102000000000000" },
100-
{ "seq_id" : 468, "qsl_idx" : 73, "data" : "DC01000000000000" },
101-
{ "seq_id" : 469, "qsl_idx" : 184, "data" : "7302000000000000" },
69+
qsl_idx" : 184, "data" : "7302000000000000" },
10270
{ "seq_id" : 470, "qsl_idx" : 195, "data" : "8C01000000000000" },
10371
{ "seq_id" : 471, "qsl_idx" : 338, "data" : "DD01000000000000" },
10472
{ "seq_id" : 472, "qsl_idx" : 40, "data" : "AF01000000000000" },
@@ -128,5 +96,37 @@
12896
{ "seq_id" : 496, "qsl_idx" : 42, "data" : "8100000000000000" },
12997
{ "seq_id" : 497, "qsl_idx" : 439, "data" : "C700000000000000" },
13098
{ "seq_id" : 498, "qsl_idx" : 219, "data" : "FE00000000000000" },
131-
{ "seq_id" : 499, "qsl_idx" : 61, "data" : "0B01000000000000" }
99+
{ "seq_id" : 499, "qsl_idx" : 61, "data" : "0B01000000000000" },
100+
{ "seq_id" : 32, "qsl_idx" : 217, "data" : "4D00000000000000" },
101+
{ "seq_id" : 33, "qsl_idx" : 102, "data" : "6803000000000000" },
102+
{ "seq_id" : 34, "qsl_idx" : 216, "data" : "1000000000000000" },
103+
{ "seq_id" : 35, "qsl_idx" : 422, "data" : "B103000000000000" },
104+
{ "seq_id" : 36, "qsl_idx" : 17, "data" : "1700000000000000" },
105+
{ "seq_id" : 37, "qsl_idx" : 143, "data" : "D602000000000000" },
106+
{ "seq_id" : 38, "qsl_idx" : 262, "data" : "B000000000000000" },
107+
{ "seq_id" : 39, "qsl_idx" : 432, "data" : "EC02000000000000" },
108+
{ "seq_id" : 40, "qsl_idx" : 252, "data" : "8702000000000000" },
109+
{ "seq_id" : 41, "qsl_idx" : 160, "data" : "A800000000000000" },
110+
{ "seq_id" : 42, "qsl_idx" : 149, "data" : "D103000000000000" },
111+
{ "seq_id" : 43, "qsl_idx" : 402, "data" : "FE01000000000000" },
112+
{ "seq_id" : 44, "qsl_idx" : 230, "data" : "7D00000000000000" },
113+
{ "seq_id" : 45, "qsl_idx" : 447, "data" : "5202000000000000" },
114+
{ "seq_id" : 46, "qsl_idx" : 401, "data" : "6703000000000000" },
115+
{ "seq_id" : 47, "qsl_idx" : 330, "data" : "7E03000000000000" },
116+
{ "seq_id" : 48, "qsl_idx" : 308, "data" : "A603000000000000" },
117+
{ "seq_id" : 49, "qsl_idx" : 249, "data" : "7E03000000000000" },
118+
{ "seq_id" : 50, "qsl_idx" : 468, "data" : "B001000000000000" },
119+
{ "seq_id" : 51, "qsl_idx" : 266, "data" : "BF03000000000000" },
120+
{ "seq_id" : 52, "qsl_idx" : 158, "data" : "4302000000000000" },
121+
{ "seq_id" : 53, "qsl_idx" : 235, "data" : "7300000000000000" },
122+
{ "seq_id" : 54, "qsl_idx" : 374, "data" : "D000000000000000" },
123+
{ "seq_id" : 55, "qsl_idx" : 56, "data" : "9A00000000000000" },
124+
{ "seq_id" : 56, "qsl_idx" : 179, "data" : "E600000000000000" },
125+
{ "seq_id" : 57, "qsl_idx" : 111, "data" : "BA03000000000000" },
126+
{ "seq_id" : 58, "qsl_idx" : 163, "data" : "F801000000000000" },
127+
{ "seq_id" : 59, "qsl_idx" : 344, "data" : "E902000000000000" },
128+
{ "seq_id" : 60, "qsl_idx" : 14, "data" : "5302000000000000" },
129+
{ "seq_id" : 61, "qsl_idx" : 283, "data" : "7103000000000000" },
130+
{ "seq_id" : 62, "qsl_idx" : 484, "data" : "0502000000000000" },
131+
{ "seq_id" : 63, "qsl_idx" : 220, "data" : "EC02000000000000" }
132132
]

0 commit comments

Comments
 (0)