Skip to content

Commit b147803

Browse files
mlcommons-botmlcommons-bot
committed
Auto-merge updates from auto-update branch
2 parents e2514cb + 99c9807 commit b147803

11 files changed

Lines changed: 220 additions & 220 deletions

File tree

‎open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.25.1-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 16.339 | - |
3+
| resnet50 | offline | 76 | 21.667 | - |

‎open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.25.1-default_config/resnet50/offline/README.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,9 @@
22

33
## Host platform
44

5-
* OS version: macOS-15.7.4-arm64-arm-64bit-Mach-O
5+
* OS version: macOS-15.7.4-arm64-arm-64bit
66
* CPU version: arm
7-
* Python version: 3.13.13 (v3.13.13:01104ce1beb, Apr 7 2026, 14:43:30) [Clang 16.0.0 (clang-1600.0.26.6)]
7+
* Python version: 3.12.10 (v3.12.10:0cc81280367, Apr 8 2025, 08:46:59) [Clang 13.0.0 (clang-1300.0.29.30)]
88
* MLC version: unknown
99

1010
## MLC Run Command
@@ -16,7 +16,7 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo mlcommons@mlperf-automations --checkout=72a4fc24f86796f45c6cce78dcfa675cd06e7030
19+
mlc pull repo mlcommons@mlperf-automations --checkout=986cedc59d0f1d80a91127f3df1b8fe73124ede8
2020

2121

2222
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `16.3389`
43+
`Samples per second`: `21.667`

‎open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.25.1-default_config/resnet50/offline/accuracy/accuracy.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
accuracy=76.000%, good=380, total=500
22

3-
hash=0691004f8e7032de41800ec03259b8ea26a56b29fc3d716a2209a4d6bb995947
3+
hash=5f9b7d749b0f43f8aab2d81328777d30b6d95464459539357165e790b88c3fa6

‎open/MLCommons/results/gh_macos-latest_x86-reference-cpu-onnxruntime_v1.25.1-default_config/resnet50/offline/accuracy/mlperf_log_accuracy.json‎

Lines changed: 33 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -75,39 +75,7 @@
7575

7676
...
7777

78-
eq_id" : 429, "qsl_idx" : 300, "data" : "0080A443" },
79-
{ "seq_id" : 430, "qsl_idx" : 4, "data" : "00000144" },
80-
{ "seq_id" : 431, "qsl_idx" : 325, "data" : "0080B343" },
81-
{ "seq_id" : 432, "qsl_idx" : 112, "data" : "00006343" },
82-
{ "seq_id" : 433, "qsl_idx" : 100, "data" : "0080EC43" },
83-
{ "seq_id" : 434, "qsl_idx" : 247, "data" : "00003343" },
84-
{ "seq_id" : 435, "qsl_idx" : 267, "data" : "0080CE43" },
85-
{ "seq_id" : 436, "qsl_idx" : 491, "data" : "0000A041" },
86-
{ "seq_id" : 437, "qsl_idx" : 319, "data" : "00806E44" },
87-
{ "seq_id" : 438, "qsl_idx" : 125, "data" : "0080E443" },
88-
{ "seq_id" : 439, "qsl_idx" : 285, "data" : "00006844" },
89-
{ "seq_id" : 440, "qsl_idx" : 496, "data" : "00806144" },
90-
{ "seq_id" : 441, "qsl_idx" : 293, "data" : "00805844" },
91-
{ "seq_id" : 442, "qsl_idx" : 2, "data" : "00006643" },
92-
{ "seq_id" : 443, "qsl_idx" : 134, "data" : "00C03B44" },
93-
{ "seq_id" : 444, "qsl_idx" : 76, "data" : "00001F43" },
94-
{ "seq_id" : 445, "qsl_idx" : 304, "data" : "00C01344" },
95-
{ "seq_id" : 446, "qsl_idx" : 10, "data" : "0000DA42" },
96-
{ "seq_id" : 447, "qsl_idx" : 131, "data" : "00400A44" },
97-
{ "seq_id" : 448, "qsl_idx" : 401, "data" : "00C05944" },
98-
{ "seq_id" : 449, "qsl_idx" : 422, "data" : "00406C44" },
99-
{ "seq_id" : 450, "qsl_idx" : 46, "data" : "00400D44" },
100-
{ "seq_id" : 451, "qsl_idx" : 186, "data" : "00C05844" },
101-
{ "seq_id" : 452, "qsl_idx" : 164, "data" : "00406A44" },
102-
{ "seq_id" : 453, "qsl_idx" : 264, "data" : "00804344" },
103-
{ "seq_id" : 454, "qsl_idx" : 453, "data" : "00803A44" },
104-
{ "seq_id" : 455, "qsl_idx" : 145, "data" : "00C05A44" },
105-
{ "seq_id" : 456, "qsl_idx" : 79, "data" : "0080E643" },
106-
{ "seq_id" : 457, "qsl_idx" : 352, "data" : "0080F043" },
107-
{ "seq_id" : 458, "qsl_idx" : 185, "data" : "00809043" },
108-
{ "seq_id" : 459, "qsl_idx" : 286, "data" : "0000D543" },
109-
{ "seq_id" : 460, "qsl_idx" : 160, "data" : "00002843" },
110-
{ "seq_id" : 461, "qsl_idx" : 89, "data" : "00004842" },
78+
eq_id" : 461, "qsl_idx" : 89, "data" : "00004842" },
11179
{ "seq_id" : 462, "qsl_idx" : 34, "data" : "00801244" },
11280
{ "seq_id" : 463, "qsl_idx" : 391, "data" : "0080EB43" },
11381
{ "seq_id" : 464, "qsl_idx" : 438, "data" : "00008041" },
@@ -126,6 +94,38 @@ eq_id" : 429, "qsl_idx" : 300, "data" : "0080A443" },
12694
{ "seq_id" : 477, "qsl_idx" : 237, "data" : "0000F242" },
12795
{ "seq_id" : 478, "qsl_idx" : 143, "data" : "00803544" },
12896
{ "seq_id" : 479, "qsl_idx" : 261, "data" : "0000803F" },
97+
{ "seq_id" : 416, "qsl_idx" : 316, "data" : "00801644" },
98+
{ "seq_id" : 417, "qsl_idx" : 274, "data" : "00403E44" },
99+
{ "seq_id" : 418, "qsl_idx" : 86, "data" : "0080BE43" },
100+
{ "seq_id" : 419, "qsl_idx" : 68, "data" : "00805944" },
101+
{ "seq_id" : 420, "qsl_idx" : 153, "data" : "0000E642" },
102+
{ "seq_id" : 421, "qsl_idx" : 260, "data" : "00405844" },
103+
{ "seq_id" : 422, "qsl_idx" : 281, "data" : "00801844" },
104+
{ "seq_id" : 423, "qsl_idx" : 191, "data" : "00809643" },
105+
{ "seq_id" : 424, "qsl_idx" : 276, "data" : "0000E843" },
106+
{ "seq_id" : 425, "qsl_idx" : 211, "data" : "00405E44" },
107+
{ "seq_id" : 426, "qsl_idx" : 333, "data" : "00001A44" },
108+
{ "seq_id" : 427, "qsl_idx" : 359, "data" : "00001243" },
109+
{ "seq_id" : 428, "qsl_idx" : 118, "data" : "00C05444" },
110+
{ "seq_id" : 429, "qsl_idx" : 300, "data" : "0080A443" },
111+
{ "seq_id" : 430, "qsl_idx" : 4, "data" : "00000144" },
112+
{ "seq_id" : 431, "qsl_idx" : 325, "data" : "0080B343" },
113+
{ "seq_id" : 432, "qsl_idx" : 112, "data" : "00006343" },
114+
{ "seq_id" : 433, "qsl_idx" : 100, "data" : "0080EC43" },
115+
{ "seq_id" : 434, "qsl_idx" : 247, "data" : "00003343" },
116+
{ "seq_id" : 435, "qsl_idx" : 267, "data" : "0080CE43" },
117+
{ "seq_id" : 436, "qsl_idx" : 491, "data" : "0000A041" },
118+
{ "seq_id" : 437, "qsl_idx" : 319, "data" : "00806E44" },
119+
{ "seq_id" : 438, "qsl_idx" : 125, "data" : "0080E443" },
120+
{ "seq_id" : 439, "qsl_idx" : 285, "data" : "00006844" },
121+
{ "seq_id" : 440, "qsl_idx" : 496, "data" : "00806144" },
122+
{ "seq_id" : 441, "qsl_idx" : 293, "data" : "00805844" },
123+
{ "seq_id" : 442, "qsl_idx" : 2, "data" : "00006643" },
124+
{ "seq_id" : 443, "qsl_idx" : 134, "data" : "00C03B44" },
125+
{ "seq_id" : 444, "qsl_idx" : 76, "data" : "00001F43" },
126+
{ "seq_id" : 445, "qsl_idx" : 304, "data" : "00C01344" },
127+
{ "seq_id" : 446, "qsl_idx" : 10, "data" : "0000DA42" },
128+
{ "seq_id" : 447, "qsl_idx" : 131, "data" : "00400A44" },
129129
{ "seq_id" : 480, "qsl_idx" : 400, "data" : "0080B343" },
130130
{ "seq_id" : 481, "qsl_idx" : 424, "data" : "00008543" },
131131
{ "seq_id" : 482, "qsl_idx" : 390, "data" : "00003943" },

0 commit comments

Comments
 (0)