Skip to content

Commit e7aecd6

Browse files
committed
Auto-merge updates from auto-update branch
2 parents f8b0ea8 + dfa2383 commit e7aecd6

9 files changed

Lines changed: 219 additions & 218 deletions

File tree

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 21.368 | - |
3+
| resnet50 | offline | 76 | 28.026 | - |

open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.27.0-default_config/resnet50/offline/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo mlcommons@mlperf-automations --checkout=96285eaec005baf486978712dea353c744dc73a7
19+
mlc pull repo mlcommons@mlperf-automations --checkout=fa0a2e0938e37d191d679b21d698aa56cd15ec05
2020

2121

2222
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `21.3677`
43+
`Samples per second`: `28.026`
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
accuracy=76.000%, good=380, total=500
22

3-
hash=0e86e681603d9e82a09ec7cb1310133a69f334b16eb77fa67a844b4c2fb99b7d
3+
hash=35f99c5472baba0b4838e6e1158f617a65faad0eef4d037f2f5836b7bf5a2181

open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.27.0-default_config/resnet50/offline/accuracy/mlperf_log_accuracy.json

Lines changed: 34 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -1,36 +1,4 @@
11
[
2-
{ "seq_id" : 96, "qsl_idx" : 191, "data" : "00809643" },
3-
{ "seq_id" : 97, "qsl_idx" : 347, "data" : "00809243" },
4-
{ "seq_id" : 98, "qsl_idx" : 38, "data" : "00404244" },
5-
{ "seq_id" : 99, "qsl_idx" : 198, "data" : "00000944" },
6-
{ "seq_id" : 100, "qsl_idx" : 253, "data" : "00002544" },
7-
{ "seq_id" : 101, "qsl_idx" : 187, "data" : "00008843" },
8-
{ "seq_id" : 102, "qsl_idx" : 395, "data" : "00009842" },
9-
{ "seq_id" : 103, "qsl_idx" : 482, "data" : "0080DA43" },
10-
{ "seq_id" : 104, "qsl_idx" : 455, "data" : "0000AD43" },
11-
{ "seq_id" : 105, "qsl_idx" : 243, "data" : "00001544" },
12-
{ "seq_id" : 106, "qsl_idx" : 162, "data" : "00C02144" },
13-
{ "seq_id" : 107, "qsl_idx" : 475, "data" : "00009041" },
14-
{ "seq_id" : 108, "qsl_idx" : 476, "data" : "00001244" },
15-
{ "seq_id" : 109, "qsl_idx" : 369, "data" : "0000B642" },
16-
{ "seq_id" : 110, "qsl_idx" : 165, "data" : "00C02B44" },
17-
{ "seq_id" : 111, "qsl_idx" : 424, "data" : "00008543" },
18-
{ "seq_id" : 112, "qsl_idx" : 146, "data" : "00808443" },
19-
{ "seq_id" : 113, "qsl_idx" : 397, "data" : "00405544" },
20-
{ "seq_id" : 114, "qsl_idx" : 381, "data" : "00402244" },
21-
{ "seq_id" : 115, "qsl_idx" : 261, "data" : "0000803F" },
22-
{ "seq_id" : 116, "qsl_idx" : 25, "data" : "00805344" },
23-
{ "seq_id" : 117, "qsl_idx" : 71, "data" : "00001543" },
24-
{ "seq_id" : 118, "qsl_idx" : 270, "data" : "00404D44" },
25-
{ "seq_id" : 119, "qsl_idx" : 150, "data" : "00402A44" },
26-
{ "seq_id" : 120, "qsl_idx" : 145, "data" : "00C05A44" },
27-
{ "seq_id" : 121, "qsl_idx" : 291, "data" : "00005644" },
28-
{ "seq_id" : 122, "qsl_idx" : 177, "data" : "00007843" },
29-
{ "seq_id" : 123, "qsl_idx" : 186, "data" : "00C05844" },
30-
{ "seq_id" : 124, "qsl_idx" : 346, "data" : "0000EC43" },
31-
{ "seq_id" : 125, "qsl_idx" : 167, "data" : "00802644" },
32-
{ "seq_id" : 126, "qsl_idx" : 246, "data" : "00005041" },
33-
{ "seq_id" : 127, "qsl_idx" : 326, "data" : "00006A43" },
342
{ "seq_id" : 64, "qsl_idx" : 192, "data" : "0080E043" },
353
{ "seq_id" : 65, "qsl_idx" : 211, "data" : "00405E44" },
364
{ "seq_id" : 66, "qsl_idx" : 129, "data" : "00808D43" },
@@ -70,7 +38,40 @@
7038
{ "seq_id" : 4, "qsl_idx" : 412, "data" : "00005144" },
7139
{ "seq_id" : 5, "qsl_idx" : 75, "data" : "0080CF43" },
7240
{ "seq_id" : 6, "qsl_idx" : 329, "data" : "00400344" },
73-
{ "seq_id" : 7, "qsl_idx" : 269, "data
41+
{ "seq_id" : 7, "qsl_idx" : 269, "data" : "00803844" },
42+
{ "seq_id" : 8, "qsl_idx" : 260, "data" : "00405844" },
43+
{ "seq_id" : 9, "qsl_idx" : 349, "data" : "00004343" },
44+
{ "seq_id" : 10, "qsl_idx" : 429, "data" : "00802844" },
45+
{ "seq_id" : 11, "qsl_idx" : 227, "data" : "00400644" },
46+
{ "seq_id" : 12, "qsl_idx" : 274, "data" : "00403E44" },
47+
{ "seq_id" : 13, "qsl_idx" : 325, "data" : "0080B343" },
48+
{ "seq_id" : 14, "qsl_idx" : 161, "data" : "00805F44" },
49+
{ "seq_id" : 15, "qsl_idx" : 63, "data" : "00003842" },
50+
{ "seq_id" : 16, "qsl_idx" : 5, "data" : "00008642" },
51+
{ "seq_id" : 17, "qsl_idx" : 69, "data" : "00405244" },
52+
{ "seq_id" : 18, "qsl_idx" : 430, "data" : "0000EA43" },
53+
{ "seq_id" : 19, "qsl_idx" : 85, "data" : "0000F943" },
54+
{ "seq_id" : 20, "qsl_idx" : 275, "data" : "0000D841" },
55+
{ "seq_id" : 21, "qsl_idx" : 43, "data" : "00004643" },
56+
{ "seq_id" : 22, "qsl_idx" : 37, "data" : "0000C743" },
57+
{ "seq_id" : 23, "qsl_idx" : 134, "data" : "00C03B44" },
58+
{ "seq_id" : 24, "qsl_idx" : 97, "data" : "00000E43" },
59+
{ "seq_id" : 25, "qsl_idx" : 425, "data" : "00C01F44" },
60+
{ "seq_id" : 26, "qsl_idx" : 423, "data" : "00002043" },
61+
{ "seq_id" : 27, "qsl_idx" : 125, "data" : "0080E443" },
62+
{ "seq_id" : 28, "qsl_idx" : 255, "data" : "00400544" },
63+
{ "seq_id" : 29, "qsl_idx" : 229, "data" : "00403944" },
64+
{ "seq_id" : 30, "qsl_idx" : 6, "data" : "0000A743" },
65+
{ "seq_id" : 31, "qsl_idx" : 348, "data" : "00004C44" },
66+
{ "seq_id" : 96, "qsl_idx" : 191, "data" : "00809643" },
67+
{ "seq_id" : 97, "qsl_idx" : 347, "data" : "00809243" },
68+
{ "seq_id" : 98, "qsl_idx" : 38, "data" : "00404244" },
69+
{ "seq_id" : 99, "qsl_idx" : 198, "data" : "00000944" },
70+
{ "seq_id" : 100, "qsl_idx" : 253, "data" : "00002544" },
71+
{ "seq_id" : 101, "qsl_idx" : 187, "data" : "00008843" },
72+
{ "seq_id" : 102, "qsl_idx" : 395, "data" : "00009842" },
73+
{ "seq_id" : 103, "qsl_idx" : 482, "data" : "0080DA43" },
74+
{ "seq_id" : 104
7475

7576
...
7677

0 commit comments

Comments
 (0)