Skip to content

Commit 8d3ba54

Browse files
mlcommons-botmlcommons-bot
committed
Auto-merge updates from auto-update branch
2 parents 0984db1 + 60a5d82 commit 8d3ba54

9 files changed

Lines changed: 263 additions & 264 deletions

File tree

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.21.0-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 21.114 | - |
3+
| resnet50 | offline | 76 | 21.159 | - |

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.21.0-default_config/resnet50/offline/README.md‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -16,16 +16,16 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo GATEOverflow@mlperf-automations --checkout=9c2f85db548254d709ca80cd7474932d26ee27d5
19+
mlc pull repo mlcommons@mlperf-automations --checkout=d71465f5b4dafcd0352ec15ac9f017292fee7a65
2020

2121

2222
```
2323
*Note that if you want to use the [latest automation recipes](https://docs.mlcommons.org/inference) for MLPerf,
24-
you should simply reload GATEOverflow@mlperf-automations without checkout and clean MLC cache as follows:*
24+
you should simply reload mlcommons@mlperf-automations without checkout and clean MLC cache as follows:*
2525

2626
```bash
27-
mlc rm repo GATEOverflow@mlperf-automations
28-
mlc pull repo GATEOverflow@mlperf-automations
27+
mlc rm repo mlcommons@mlperf-automations
28+
mlc pull repo mlcommons@mlperf-automations
2929
mlc rm cache -f
3030

3131
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `21.1142`
43+
`Samples per second`: `21.1591`

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.21.0-default_config/resnet50/offline/accuracy/accuracy.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
accuracy=76.000%, good=380, total=500
22

3-
hash=65bb20f9c106f05aa2fc296a4e7210abe2172de0c4ccbf83f102906616b55e45
3+
hash=2da6917d0f8bb1f504a3471a619efe59578cd36a0486b31b31c594e2ee0b1742

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.21.0-default_config/resnet50/offline/accuracy/mlperf_log_accuracy.json‎

Lines changed: 66 additions & 67 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,36 @@
11
[
2+
{ "seq_id" : 96, "qsl_idx" : 191, "data" : "00809643" },
3+
{ "seq_id" : 97, "qsl_idx" : 347, "data" : "00809243" },
4+
{ "seq_id" : 98, "qsl_idx" : 38, "data" : "00404244" },
5+
{ "seq_id" : 99, "qsl_idx" : 198, "data" : "00000944" },
6+
{ "seq_id" : 100, "qsl_idx" : 253, "data" : "00002544" },
7+
{ "seq_id" : 101, "qsl_idx" : 187, "data" : "00008843" },
8+
{ "seq_id" : 102, "qsl_idx" : 395, "data" : "00009842" },
9+
{ "seq_id" : 103, "qsl_idx" : 482, "data" : "0080DA43" },
10+
{ "seq_id" : 104, "qsl_idx" : 455, "data" : "0000AD43" },
11+
{ "seq_id" : 105, "qsl_idx" : 243, "data" : "00001544" },
12+
{ "seq_id" : 106, "qsl_idx" : 162, "data" : "00C02144" },
13+
{ "seq_id" : 107, "qsl_idx" : 475, "data" : "00009041" },
14+
{ "seq_id" : 108, "qsl_idx" : 476, "data" : "00001244" },
15+
{ "seq_id" : 109, "qsl_idx" : 369, "data" : "0000B642" },
16+
{ "seq_id" : 110, "qsl_idx" : 165, "data" : "00C02B44" },
17+
{ "seq_id" : 111, "qsl_idx" : 424, "data" : "00008543" },
18+
{ "seq_id" : 112, "qsl_idx" : 146, "data" : "00808443" },
19+
{ "seq_id" : 113, "qsl_idx" : 397, "data" : "00405544" },
20+
{ "seq_id" : 114, "qsl_idx" : 381, "data" : "00402244" },
21+
{ "seq_id" : 115, "qsl_idx" : 261, "data" : "0000803F" },
22+
{ "seq_id" : 116, "qsl_idx" : 25, "data" : "00805344" },
23+
{ "seq_id" : 117, "qsl_idx" : 71, "data" : "00001543" },
24+
{ "seq_id" : 118, "qsl_idx" : 270, "data" : "00404D44" },
25+
{ "seq_id" : 119, "qsl_idx" : 150, "data" : "00402A44" },
26+
{ "seq_id" : 120, "qsl_idx" : 145, "data" : "00C05A44" },
27+
{ "seq_id" : 121, "qsl_idx" : 291, "data" : "00005644" },
28+
{ "seq_id" : 122, "qsl_idx" : 177, "data" : "00007843" },
29+
{ "seq_id" : 123, "qsl_idx" : 186, "data" : "00C05844" },
30+
{ "seq_id" : 124, "qsl_idx" : 346, "data" : "0000EC43" },
31+
{ "seq_id" : 125, "qsl_idx" : 167, "data" : "00802644" },
32+
{ "seq_id" : 126, "qsl_idx" : 246, "data" : "00005041" },
33+
{ "seq_id" : 127, "qsl_idx" : 326, "data" : "00006A43" },
234
{ "seq_id" : 0, "qsl_idx" : 334, "data" : "00C03044" },
335
{ "seq_id" : 1, "qsl_idx" : 404, "data" : "00003143" },
436
{ "seq_id" : 2, "qsl_idx" : 332, "data" : "00007E43" },
@@ -31,47 +63,14 @@
3163
{ "seq_id" : 29, "qsl_idx" : 229, "data" : "00403944" },
3264
{ "seq_id" : 30, "qsl_idx" : 6, "data" : "0000A743" },
3365
{ "seq_id" : 31, "qsl_idx" : 348, "data" : "00004C44" },
34-
{ "seq_id" : 32, "qsl_idx" : 217, "data" : "00009A42" },
35-
{ "seq_id" : 33, "qsl_idx" : 102, "data" : "00005A44" },
36-
{ "seq_id" : 34, "qsl_idx" : 216, "data" : "00008041" },
37-
{ "seq_id" : 35, "qsl_idx" : 422, "data" : "00406C44" },
38-
{ "seq_id" : 36, "qsl_idx" : 17, "data" : "0000B841" },
39-
{ "seq_id" : 37, "qsl_idx" : 143, "data" : "00803544" },
40-
{ "seq_id" : 38, "qsl_idx" : 262, "data" : "00003043" },
41-
{ "seq_id" : 39, "qsl_idx" : 432, "data" : "00003B44" },
42-
{ "seq_id" : 40, "qsl_idx" : 252, "data" : "00C02144" },
43-
{ "seq_id" : 41, "qsl_idx" : 160, "data" : "00002843" },
44-
{ "seq_id" : 42, "qsl_idx" : 149, "data" : "00407444" },
45-
{ "seq_id" : 43, "qsl_idx" : 402, "data" : "0000FF43" },
46-
{ "seq_id" : 44, "qsl_idx" : 230, "data" : "0000FA42" },
47-
{ "seq_id" : 45, "qsl_idx" : 447, "data" : "00801444" },
48-
{ "seq_id" : 46, "qsl_idx" : 401, "data" : "00C05944" },
49-
{ "seq_id" : 47, "qsl_idx" : 330, "data" : "00805F44" },
50-
{ "seq_id" : 48, "qsl_idx" : 308, "data" : "00806944" },
51-
{ "seq_id" : 49, "qsl_idx" : 249, "data" : "00805F44" },
52-
{ "seq_id" : 50, "qsl_idx" : 468, "data" : "0000D843" },
53-
{ "seq_id" : 51, "qsl_idx" : 266, "data" : "00C06F44" },
54-
{ "seq_id" : 52, "qsl_idx" : 158, "data" : "00C01044" },
55-
{ "seq_id" : 53, "qsl_idx" : 235, "data" : "0000E642" },
56-
{ "seq_id" : 54, "qsl_idx" : 374, "data" : "00005043" },
57-
{ "seq_id" : 55, "qsl_idx" : 56, "data" : "00001A43" },
58-
{ "seq_id" : 56, "qsl_idx" : 179, "data" : "00006643" },
59-
{ "seq_id" : 57, "qsl_idx" : 111, "data" : "00806E44" },
60-
{ "seq_id" : 58, "qsl_idx" : 163, "data" : "0000FC43" },
61-
{ "seq_id" : 59, "qsl_idx" : 344, "data" : "00403A44" },
62-
{ "seq_id" : 60, "qsl_idx" : 14, "data" : "00C01444" },
63-
{ "seq_id" : 61, "qsl_idx" : 283, "data" : "00405C44" },
64-
{ "seq_id" : 62, "qsl_idx" : 484, "data" : "00400144" },
65-
{ "seq_id" : 63, "qsl_idx" : 220, "data" : "00003B44" },
6666
{ "seq_id" : 64, "qsl_idx" : 192, "data" : "0080E043" },
6767
{ "seq_id" : 65, "qsl_idx" : 211, "data" : "00405E44" },
6868
{ "seq_id" : 66, "qsl_idx" : 129, "data" : "00808D43" },
6969
{ "seq_id" : 67, "qsl_idx" : 292, "data" : "0000C543" },
7070
{ "seq_id" : 68, "qsl_idx" : 335, "data" : "0080E743" },
7171
{ "seq_id" : 69, "qsl_idx" : 218, "data" : "00801844" },
7272
{ "seq_id" : 70, "qsl_idx" : 190, "data" : "00007343" },
73-
{ "seq_id" : 71, "qsl_idx" : 228, "data" : "00000C42" },
74-
{ "seq_id" : 72
73+
{ "seq_id" : 71, "qsl_idx" : 228, "data" : "
7574

7675
...
7776

@@ -82,38 +81,6 @@ id" : 409, "qsl_idx" : 106, "data" : "00008C42" },
8281
{ "seq_id" : 413, "qsl_idx" : 238, "data" : "00005B44" },
8382
{ "seq_id" : 414, "qsl_idx" : 462, "data" : "00C06B44" },
8483
{ "seq_id" : 415, "qsl_idx" : 138, "data" : "00C07144" },
85-
{ "seq_id" : 416, "qsl_idx" : 196, "data" : "00806944" },
86-
{ "seq_id" : 417, "qsl_idx" : 314, "data" : "0000D243" },
87-
{ "seq_id" : 418, "qsl_idx" : 281, "data" : "00801844" },
88-
{ "seq_id" : 419, "qsl_idx" : 365, "data" : "0080E843" },
89-
{ "seq_id" : 420, "qsl_idx" : 156, "data" : "00808A43" },
90-
{ "seq_id" : 421, "qsl_idx" : 223, "data" : "00004F43" },
91-
{ "seq_id" : 422, "qsl_idx" : 258, "data" : "00002144" },
92-
{ "seq_id" : 423, "qsl_idx" : 461, "data" : "00001843" },
93-
{ "seq_id" : 424, "qsl_idx" : 307, "data" : "00C01744" },
94-
{ "seq_id" : 425, "qsl_idx" : 342, "data" : "0080B143" },
95-
{ "seq_id" : 426, "qsl_idx" : 44, "data" : "00008043" },
96-
{ "seq_id" : 427, "qsl_idx" : 193, "data" : "00C04044" },
97-
{ "seq_id" : 428, "qsl_idx" : 83, "data" : "00006842" },
98-
{ "seq_id" : 429, "qsl_idx" : 224, "data" : "0000C841" },
99-
{ "seq_id" : 430, "qsl_idx" : 393, "data" : "00807344" },
100-
{ "seq_id" : 431, "qsl_idx" : 12, "data" : "0000B943" },
101-
{ "seq_id" : 432, "qsl_idx" : 77, "data" : "00808943" },
102-
{ "seq_id" : 433, "qsl_idx" : 313, "data" : "00002444" },
103-
{ "seq_id" : 434, "qsl_idx" : 22, "data" : "00006D44" },
104-
{ "seq_id" : 435, "qsl_idx" : 225, "data" : "00800244" },
105-
{ "seq_id" : 436, "qsl_idx" : 416, "data" : "0000C743" },
106-
{ "seq_id" : 437, "qsl_idx" : 175, "data" : "00004743" },
107-
{ "seq_id" : 438, "qsl_idx" : 52, "data" : "00005344" },
108-
{ "seq_id" : 439, "qsl_idx" : 434, "data" : "00003B44" },
109-
{ "seq_id" : 440, "qsl_idx" : 114, "data" : "00007D43" },
110-
{ "seq_id" : 441, "qsl_idx" : 65, "data" : "0000C343" },
111-
{ "seq_id" : 442, "qsl_idx" : 74, "data" : "0000A042" },
112-
{ "seq_id" : 443, "qsl_idx" : 241, "data" : "0000B743" },
113-
{ "seq_id" : 444, "qsl_idx" : 318, "data" : "0000CC42" },
114-
{ "seq_id" : 445, "qsl_idx" : 110, "data" : "0000F442" },
115-
{ "seq_id" : 446, "qsl_idx" : 109, "data" : "00405144" },
116-
{ "seq_id" : 447, "qsl_idx" : 478, "data" : "00C05A44" },
11784
{ "seq_id" : 448, "qsl_idx" : 31, "data" : "00400F44" },
11885
{ "seq_id" : 449, "qsl_idx" : 268, "data" : "00808043" },
11986
{ "seq_id" : 450, "qsl_idx" : 396, "data" : "00005544" },
@@ -145,5 +112,37 @@ id" : 409, "qsl_idx" : 106, "data" : "00008C42" },
145112
{ "seq_id" : 476, "qsl_idx" : 493, "data" : "0000D043" },
146113
{ "seq_id" : 477, "qsl_idx" : 293, "data" : "00805844" },
147114
{ "seq_id" : 478, "qsl_idx" : 141, "data" : "0000A443" },
148-
{ "seq_id" : 479, "qsl_idx" : 90, "data" : "00008743" }
115+
{ "seq_id" : 479, "qsl_idx" : 90, "data" : "00008743" },
116+
{ "seq_id" : 416, "qsl_idx" : 196, "data" : "00806944" },
117+
{ "seq_id" : 417, "qsl_idx" : 314, "data" : "0000D243" },
118+
{ "seq_id" : 418, "qsl_idx" : 281, "data" : "00801844" },
119+
{ "seq_id" : 419, "qsl_idx" : 365, "data" : "0080E843" },
120+
{ "seq_id" : 420, "qsl_idx" : 156, "data" : "00808A43" },
121+
{ "seq_id" : 421, "qsl_idx" : 223, "data" : "00004F43" },
122+
{ "seq_id" : 422, "qsl_idx" : 258, "data" : "00002144" },
123+
{ "seq_id" : 423, "qsl_idx" : 461, "data" : "00001843" },
124+
{ "seq_id" : 424, "qsl_idx" : 307, "data" : "00C01744" },
125+
{ "seq_id" : 425, "qsl_idx" : 342, "data" : "0080B143" },
126+
{ "seq_id" : 426, "qsl_idx" : 44, "data" : "00008043" },
127+
{ "seq_id" : 427, "qsl_idx" : 193, "data" : "00C04044" },
128+
{ "seq_id" : 428, "qsl_idx" : 83, "data" : "00006842" },
129+
{ "seq_id" : 429, "qsl_idx" : 224, "data" : "0000C841" },
130+
{ "seq_id" : 430, "qsl_idx" : 393, "data" : "00807344" },
131+
{ "seq_id" : 431, "qsl_idx" : 12, "data" : "0000B943" },
132+
{ "seq_id" : 432, "qsl_idx" : 77, "data" : "00808943" },
133+
{ "seq_id" : 433, "qsl_idx" : 313, "data" : "00002444" },
134+
{ "seq_id" : 434, "qsl_idx" : 22, "data" : "00006D44" },
135+
{ "seq_id" : 435, "qsl_idx" : 225, "data" : "00800244" },
136+
{ "seq_id" : 436, "qsl_idx" : 416, "data" : "0000C743" },
137+
{ "seq_id" : 437, "qsl_idx" : 175, "data" : "00004743" },
138+
{ "seq_id" : 438, "qsl_idx" : 52, "data" : "00005344" },
139+
{ "seq_id" : 439, "qsl_idx" : 434, "data" : "00003B44" },
140+
{ "seq_id" : 440, "qsl_idx" : 114, "data" : "00007D43" },
141+
{ "seq_id" : 441, "qsl_idx" : 65, "data" : "0000C343" },
142+
{ "seq_id" : 442, "qsl_idx" : 74, "data" : "0000A042" },
143+
{ "seq_id" : 443, "qsl_idx" : 241, "data" : "0000B743" },
144+
{ "seq_id" : 444, "qsl_idx" : 318, "data" : "0000CC42" },
145+
{ "seq_id" : 445, "qsl_idx" : 110, "data" : "0000F442" },
146+
{ "seq_id" : 446, "qsl_idx" : 109, "data" : "00405144" },
147+
{ "seq_id" : 447, "qsl_idx" : 478, "data" : "00C05A44" }
149148
]

0 commit comments

Comments
 (0)