Skip to content

Commit d0be578

Browse files
mlcommons-botmlcommons-bot
committed
Results from R50 GH action on ubuntu-latest
1 parent 24ca57f commit d0be578

11 files changed

Lines changed: 238 additions & 238 deletions

File tree

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.21.0-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 21.167 | - |
3+
| resnet50 | offline | 76 | 21.105 | - |

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.21.0-default_config/resnet50/offline/README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo mlcommons@mlperf-automations --checkout=fa0a2e0938e37d191d679b21d698aa56cd15ec05
19+
mlc pull repo mlcommons@mlperf-automations --checkout=e0ce47d622ecb71625fb9f5830695d640c3dce7a
2020

2121

2222
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `21.1666`
43+
`Samples per second`: `21.1053`

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.21.0-default_config/resnet50/offline/accuracy/accuracy.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
accuracy=76.000%, good=380, total=500
22

3-
hash=6104fd194ef7a1ee5498e5669d068f5e3f90096511b00262e5397ae38b6de169
3+
hash=963e55bc3a279eba2d2a39f2924b9621255ed5972e069f38f2873da46379a6ba

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-tf_v2.21.0-default_config/resnet50/offline/accuracy/mlperf_log_accuracy.json‎

Lines changed: 41 additions & 41 deletions
Original file line numberDiff line numberDiff line change
@@ -1,36 +1,4 @@
11
[
2-
{ "seq_id" : 64, "qsl_idx" : 192, "data" : "0080E043" },
3-
{ "seq_id" : 65, "qsl_idx" : 211, "data" : "00405E44" },
4-
{ "seq_id" : 66, "qsl_idx" : 129, "data" : "00808D43" },
5-
{ "seq_id" : 67, "qsl_idx" : 292, "data" : "0000C543" },
6-
{ "seq_id" : 68, "qsl_idx" : 335, "data" : "0080E743" },
7-
{ "seq_id" : 69, "qsl_idx" : 218, "data" : "00801844" },
8-
{ "seq_id" : 70, "qsl_idx" : 190, "data" : "00007343" },
9-
{ "seq_id" : 71, "qsl_idx" : 228, "data" : "00000C42" },
10-
{ "seq_id" : 72, "qsl_idx" : 378, "data" : "00004743" },
11-
{ "seq_id" : 73, "qsl_idx" : 394, "data" : "00009442" },
12-
{ "seq_id" : 74, "qsl_idx" : 24, "data" : "0000B841" },
13-
{ "seq_id" : 75, "qsl_idx" : 285, "data" : "00006844" },
14-
{ "seq_id" : 76, "qsl_idx" : 267, "data" : "0080CE43" },
15-
{ "seq_id" : 77, "qsl_idx" : 368, "data" : "00003A44" },
16-
{ "seq_id" : 78, "qsl_idx" : 454, "data" : "00004544" },
17-
{ "seq_id" : 79, "qsl_idx" : 400, "data" : "0080B343" },
18-
{ "seq_id" : 80, "qsl_idx" : 185, "data" : "00809043" },
19-
{ "seq_id" : 81, "qsl_idx" : 480, "data" : "0000C243" },
20-
{ "seq_id" : 82, "qsl_idx" : 18, "data" : "0000EF43" },
21-
{ "seq_id" : 83, "qsl_idx" : 382, "data" : "00006443" },
22-
{ "seq_id" : 84, "qsl_idx" : 407, "data" : "00807944" },
23-
{ "seq_id" : 85, "qsl_idx" : 443, "data" : "0000AF43" },
24-
{ "seq_id" : 86, "qsl_idx" : 282, "data" : "00808D43" },
25-
{ "seq_id" : 87, "qsl_idx" : 92, "data" : "0000B743" },
26-
{ "seq_id" : 88, "qsl_idx" : 59, "data" : "00001344" },
27-
{ "seq_id" : 89, "qsl_idx" : 35, "data" : "00C05D44" },
28-
{ "seq_id" : 90, "qsl_idx" : 194, "data" : "0000EC42" },
29-
{ "seq_id" : 91, "qsl_idx" : 418, "data" : "00402A44" },
30-
{ "seq_id" : 92, "qsl_idx" : 487, "data" : "00803C44" },
31-
{ "seq_id" : 93, "qsl_idx" : 389, "data" : "00000543" },
32-
{ "seq_id" : 94, "qsl_idx" : 46, "data" : "00400D44" },
33-
{ "seq_id" : 95, "qsl_idx" : 99, "data" : "0080AE43" },
342
{ "seq_id" : 0, "qsl_idx" : 334, "data" : "00C03044" },
353
{ "seq_id" : 1, "qsl_idx" : 404, "data" : "00003143" },
364
{ "seq_id" : 2, "qsl_idx" : 332, "data" : "00007E43" },
@@ -63,15 +31,47 @@
6331
{ "seq_id" : 29, "qsl_idx" : 229, "data" : "00403944" },
6432
{ "seq_id" : 30, "qsl_idx" : 6, "data" : "0000A743" },
6533
{ "seq_id" : 31, "qsl_idx" : 348, "data" : "00004C44" },
66-
{ "seq_id" : 96, "qsl_idx" : 191, "data" : "00809643" },
67-
{ "seq_id" : 97, "qsl_idx" : 347, "data" : "00809243" },
68-
{ "seq_id" : 98, "qsl_idx" : 38, "data" : "00404244" },
69-
{ "seq_id" : 99, "qsl_idx" : 198, "data" : "00000944" },
70-
{ "seq_id" : 100, "qsl_idx" : 253, "data" : "00002544" },
71-
{ "seq_id" : 101, "qsl_idx" : 187, "data" : "00008843" },
72-
{ "seq_id" : 102, "qsl_idx" : 395, "data" : "00009842" },
73-
{ "seq_id" : 103, "qsl_idx" : 482, "data" : "0080DA43" },
74-
{ "seq_id" : 104
34+
{ "seq_id" : 64, "qsl_idx" : 192, "data" : "0080E043" },
35+
{ "seq_id" : 65, "qsl_idx" : 211, "data" : "00405E44" },
36+
{ "seq_id" : 66, "qsl_idx" : 129, "data" : "00808D43" },
37+
{ "seq_id" : 67, "qsl_idx" : 292, "data" : "0000C543" },
38+
{ "seq_id" : 68, "qsl_idx" : 335, "data" : "0080E743" },
39+
{ "seq_id" : 69, "qsl_idx" : 218, "data" : "00801844" },
40+
{ "seq_id" : 70, "qsl_idx" : 190, "data" : "00007343" },
41+
{ "seq_id" : 71, "qsl_idx" : 228, "data" : "00000C42" },
42+
{ "seq_id" : 72, "qsl_idx" : 378, "data" : "00004743" },
43+
{ "seq_id" : 73, "qsl_idx" : 394, "data" : "00009442" },
44+
{ "seq_id" : 74, "qsl_idx" : 24, "data" : "0000B841" },
45+
{ "seq_id" : 75, "qsl_idx" : 285, "data" : "00006844" },
46+
{ "seq_id" : 76, "qsl_idx" : 267, "data" : "0080CE43" },
47+
{ "seq_id" : 77, "qsl_idx" : 368, "data" : "00003A44" },
48+
{ "seq_id" : 78, "qsl_idx" : 454, "data" : "00004544" },
49+
{ "seq_id" : 79, "qsl_idx" : 400, "data" : "0080B343" },
50+
{ "seq_id" : 80, "qsl_idx" : 185, "data" : "00809043" },
51+
{ "seq_id" : 81, "qsl_idx" : 480, "data" : "0000C243" },
52+
{ "seq_id" : 82, "qsl_idx" : 18, "data" : "0000EF43" },
53+
{ "seq_id" : 83, "qsl_idx" : 382, "data" : "00006443" },
54+
{ "seq_id" : 84, "qsl_idx" : 407, "data" : "00807944" },
55+
{ "seq_id" : 85, "qsl_idx" : 443, "data" : "0000AF43" },
56+
{ "seq_id" : 86, "qsl_idx" : 282, "data" : "00808D43" },
57+
{ "seq_id" : 87, "qsl_idx" : 92, "data" : "0000B743" },
58+
{ "seq_id" : 88, "qsl_idx" : 59, "data" : "00001344" },
59+
{ "seq_id" : 89, "qsl_idx" : 35, "data" : "00C05D44" },
60+
{ "seq_id" : 90, "qsl_idx" : 194, "data" : "0000EC42" },
61+
{ "seq_id" : 91, "qsl_idx" : 418, "data" : "00402A44" },
62+
{ "seq_id" : 92, "qsl_idx" : 487, "data" : "00803C44" },
63+
{ "seq_id" : 93, "qsl_idx" : 389, "data" : "00000543" },
64+
{ "seq_id" : 94, "qsl_idx" : 46, "data" : "00400D44" },
65+
{ "seq_id" : 95, "qsl_idx" : 99, "data" : "0080AE43" },
66+
{ "seq_id" : 32, "qsl_idx" : 217, "data" : "00009A42" },
67+
{ "seq_id" : 33, "qsl_idx" : 102, "data" : "00005A44" },
68+
{ "seq_id" : 34, "qsl_idx" : 216, "data" : "00008041" },
69+
{ "seq_id" : 35, "qsl_idx" : 422, "data" : "00406C44" },
70+
{ "seq_id" : 36, "qsl_idx" : 17, "data" : "0000B841" },
71+
{ "seq_id" : 37, "qsl_idx" : 143, "data" : "00803544" },
72+
{ "seq_id" : 38, "qsl_idx" : 262, "data" : "00003043" },
73+
{ "seq_id" : 39, "qsl_idx" : 432, "data" : "00003B44" },
74+
{ "seq_id" : 40, "qs
7575

7676
...
7777

0 commit comments

Comments
 (0)