Skip to content

Commit 1ad7645

Browse files
committed
Auto-merge updates from auto-update branch
2 parents 2598bd0 + 53026fc commit 1ad7645

10 files changed

Lines changed: 214 additions & 214 deletions

File tree

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 4.999 | - |
3+
| resnet50 | offline | 76 | 6.672 | - |

open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo mlcommons@mlperf-automations --checkout=3a080f4c40e4130ed3f12801e16902b32d27768f
19+
mlc pull repo mlcommons@mlperf-automations --checkout=35b11697975c2d4d8398c172471970b2466ab835
2020

2121

2222
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `4.99935`
43+
`Samples per second`: `6.67219`
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
accuracy=76.000%, good=380, total=500
22

3-
hash=5f82b96e67f503283d356cdb7f254e79f81a59ab3db646c6694256edd84ff6b7
3+
hash=2f24dd5db11c4df4bc83056845a43acbc5105e8b3b555c76807b85c52ccc7bf3

open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy/mlperf_log_accuracy.json

Lines changed: 33 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -66,7 +66,7 @@
6666

6767
...
6868

69-
2000000000000" },
69+
"qsl_idx" : 444, "data" : "2D02000000000000" },
7070
{ "seq_id" : 470, "qsl_idx" : 80, "data" : "CA03000000000000" },
7171
{ "seq_id" : 471, "qsl_idx" : 356, "data" : "7302000000000000" },
7272
{ "seq_id" : 472, "qsl_idx" : 398, "data" : "0B01000000000000" },
@@ -97,36 +97,36 @@
9797
{ "seq_id" : 497, "qsl_idx" : 420, "data" : "FD02000000000000" },
9898
{ "seq_id" : 498, "qsl_idx" : 152, "data" : "2700000000000000" },
9999
{ "seq_id" : 499, "qsl_idx" : 458, "data" : "9E01000000000000" },
100-
{ "seq_id" : 224, "qsl_idx" : 139, "data" : "FB00000000000000" },
101-
{ "seq_id" : 225, "qsl_idx" : 438, "data" : "1000000000000000" },
102-
{ "seq_id" : 226, "qsl_idx" : 43, "data" : "C600000000000000" },
103-
{ "seq_id" : 227, "qsl_idx" : 106, "data" : "4600000000000000" },
104-
{ "seq_id" : 228, "qsl_idx" : 349, "data" : "C300000000000000" },
105-
{ "seq_id" : 229, "qsl_idx" : 135, "data" : "2A01000000000000" },
106-
{ "seq_id" : 230, "qsl_idx" : 214, "data" : "DB01000000000000" },
107-
{ "seq_id" : 231, "qsl_idx" : 255, "data" : "1502000000000000" },
108-
{ "seq_id" : 232, "qsl_idx" : 84, "data" : "CD02000000000000" },
109-
{ "seq_id" : 233, "qsl_idx" : 380, "data" : "6F03000000000000" },
110-
{ "seq_id" : 234, "qsl_idx" : 235, "data" : "7300000000000000" },
111-
{ "seq_id" : 235, "qsl_idx" : 376, "data" : "3102000000000000" },
112-
{ "seq_id" : 236, "qsl_idx" : 479, "data" : "6701000000000000" },
113-
{ "seq_id" : 237, "qsl_idx" : 182, "data" : "A703000000000000" },
114-
{ "seq_id" : 238, "qsl_idx" : 51, "data" : "1D00000000000000" },
115-
{ "seq_id" : 239, "qsl_idx" : 126, "data" : "6001000000000000" },
116-
{ "seq_id" : 240, "qsl_idx" : 92, "data" : "6E01000000000000" },
117-
{ "seq_id" : 241, "qsl_idx" : 271, "data" : "A501000000000000" },
118-
{ "seq_id" : 242, "qsl_idx" : 377, "data" : "BF03000000000000" },
119-
{ "seq_id" : 243, "qsl_idx" : 247, "data" : "B300000000000000" },
120-
{ "seq_id" : 244, "qsl_idx" : 9, "data" : "4C01000000000000" },
121-
{ "seq_id" : 245, "qsl_idx" : 343, "data" : "F701000000000000" },
122-
{ "seq_id" : 246, "qsl_idx" : 266, "data" : "BF03000000000000" },
123-
{ "seq_id" : 247, "qsl_idx" : 94, "data" : "7501000000000000" },
124-
{ "seq_id" : 248, "qsl_idx" : 178, "data" : "5301000000000000" },
125-
{ "seq_id" : 249, "qsl_idx" : 445, "data" : "6901000000000000" },
126-
{ "seq_id" : 250, "qsl_idx" : 321, "data" : "6901000000000000" },
127-
{ "seq_id" : 251, "qsl_idx" : 351, "data" : "DB01000000000000" },
128-
{ "seq_id" : 252, "qsl_idx" : 23, "data" : "D702000000000000" },
129-
{ "seq_id" : 253, "qsl_idx" : 288, "data" : "9301000000000000" },
130-
{ "seq_id" : 254, "qsl_idx" : 345, "data" : "EF01000000000000" },
131-
{ "seq_id" : 255, "qsl_idx" : 249, "data" : "7E03000000000000" }
100+
{ "seq_id" : 32, "qsl_idx" : 120, "data" : "C101000000000000" },
101+
{ "seq_id" : 33, "qsl_idx" : 134, "data" : "EF02000000000000" },
102+
{ "seq_id" : 34, "qsl_idx" : 382, "data" : "E400000000000000" },
103+
{ "seq_id" : 35, "qsl_idx" : 69, "data" : "4903000000000000" },
104+
{ "seq_id" : 36, "qsl_idx" : 156, "data" : "1501000000000000" },
105+
{ "seq_id" : 37, "qsl_idx" : 320, "data" : "FC01000000000000" },
106+
{ "seq_id" : 38, "qsl_idx" : 107, "data" : "E601000000000000" },
107+
{ "seq_id" : 39, "qsl_idx" : 115, "data" : "BF03000000000000" },
108+
{ "seq_id" : 40, "qsl_idx" : 168, "data" : "4702000000000000" },
109+
{ "seq_id" : 41, "qsl_idx" : 305, "data" : "5A01000000000000" },
110+
{ "seq_id" : 42, "qsl_idx" : 309, "data" : "3B03000000000000" },
111+
{ "seq_id" : 43, "qsl_idx" : 187, "data" : "1001000000000000" },
112+
{ "seq_id" : 44, "qsl_idx" : 67, "data" : "7703000000000000" },
113+
{ "seq_id" : 45, "qsl_idx" : 201, "data" : "C901000000000000" },
114+
{ "seq_id" : 46, "qsl_idx" : 143, "data" : "D602000000000000" },
115+
{ "seq_id" : 47, "qsl_idx" : 493, "data" : "A001000000000000" },
116+
{ "seq_id" : 48, "qsl_idx" : 160, "data" : "A800000000000000" },
117+
{ "seq_id" : 49, "qsl_idx" : 105, "data" : "8A03000000000000" },
118+
{ "seq_id" : 50, "qsl_idx" : 165, "data" : "AF02000000000000" },
119+
{ "seq_id" : 51, "qsl_idx" : 224, "data" : "1900000000000000" },
120+
{ "seq_id" : 52, "qsl_idx" : 429, "data" : "A202000000000000" },
121+
{ "seq_id" : 53, "qsl_idx" : 16, "data" : "4701000000000000" },
122+
{ "seq_id" : 54, "qsl_idx" : 283, "data" : "7103000000000000" },
123+
{ "seq_id" : 55, "qsl_idx" : 409, "data" : "5602000000000000" },
124+
{ "seq_id" : 56, "qsl_idx" : 460, "data" : "AC03000000000000" },
125+
{ "seq_id" : 57, "qsl_idx" : 89, "data" : "3200000000000000" },
126+
{ "seq_id" : 58, "qsl_idx" : 365, "data" : "D101000000000000" },
127+
{ "seq_id" : 59, "qsl_idx" : 14, "data" : "5302000000000000" },
128+
{ "seq_id" : 60, "qsl_idx" : 443, "data" : "5E01000000000000" },
129+
{ "seq_id" : 61, "qsl_idx" : 203, "data" : "5102000000000000" },
130+
{ "seq_id" : 62, "qsl_idx" : 360, "data" : "2C01000000000000" },
131+
{ "seq_id" : 63, "qsl_idx" : 97, "data" : "8E00000000000000" }
132132
]

0 commit comments

Comments
 (0)