Skip to content

Commit 18d0dbb

Browse files
mlcommons-botmlcommons-bot
committed
Auto-merge updates from auto-update branch
2 parents 3b606ff + 8ec4141 commit 18d0dbb

11 files changed

Lines changed: 315 additions & 315 deletions

File tree

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 23.062 | - |
3+
| resnet50 | offline | 76 | 23.326 | - |

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/README.md‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -16,16 +16,16 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo mlcommons@mlperf-automations --checkout=e0ce47d622ecb71625fb9f5830695d640c3dce7a
19+
mlc pull repo amd@mlperf-automations --checkout=080f8cfc8baf4213b61ca386edc9f12c9df9217a
2020

2121

2222
```
2323
*Note that if you want to use the [latest automation recipes](https://docs.mlcommons.org/inference) for MLPerf,
24-
you should simply reload mlcommons@mlperf-automations without checkout and clean MLC cache as follows:*
24+
you should simply reload amd@mlperf-automations without checkout and clean MLC cache as follows:*
2525

2626
```bash
27-
mlc rm repo mlcommons@mlperf-automations
28-
mlc pull repo mlcommons@mlperf-automations
27+
mlc rm repo amd@mlperf-automations
28+
mlc pull repo amd@mlperf-automations
2929
mlc rm cache -f
3030

3131
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `23.0623`
43+
`Samples per second`: `23.3258`

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy/accuracy.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
accuracy=76.000%, good=380, total=500
22

3-
hash=a12819531f524d6f4152637225fd2c43f1f1c61c889e85ab3d27e2c4d6e6f148
3+
hash=73b6ff0ac2b528d10731f027a521dc38539ab75ba7e05cb9c5e5b4e409906d33

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy/mlperf_log_accuracy.json‎

Lines changed: 127 additions & 127 deletions
Large diffs are not rendered by default.

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy/mlperf_log_detail.txt‎

Lines changed: 72 additions & 72 deletions
Large diffs are not rendered by default.

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy_console.out‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
User Conf path: /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/78ca46b8dc9e4851b7c5a7ed2dad230d.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_2c953200
1+
User Conf path: /home/runner/MLC/repos/amd@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/fd5279996d214f978037328cbca5040d.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_c6b75339
33
Dataset List filepath:
44
Scenario: Offline
55
Mode: AccuracyOnly

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/os_info.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,6 @@
2626
],
2727
"MLC_HOST_PLATFORM_FLAVOR": "x86_64",
2828
"MLC_HOST_PYTHON_BITS": "64",
29-
"MLC_HOST_SYSTEM_NAME": "runnervmmklqx",
29+
"MLC_HOST_SYSTEM_NAME": "runnervmkkn4f",
3030
"MLC_HOST_FILESYSTEMS": "ext4 vfat"
3131
}

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/performance/run_1/mlperf_log_detail.txt‎

Lines changed: 90 additions & 90 deletions
Large diffs are not rendered by default.

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/performance/run_1/mlperf_log_summary.txt‎

Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ MLPerf Results Summary
44
SUT name : QueueSUT
55
Scenario : Offline
66
Mode : PerformanceOnly
7-
Samples per second: 23.0623
7+
Samples per second: 23.3258
88
Result is : VALID
99
Min duration satisfied : Yes
1010
Min queries satisfied : Yes
@@ -13,15 +13,15 @@ Result is : VALID
1313
================================================
1414
Additional Stats
1515
================================================
16-
Min latency (ns) : 1354895961
17-
Max latency (ns) : 21680382057
18-
Mean latency (ns) : 11525202608
19-
50.00 percentile latency (ns) : 11109137791
20-
90.00 percentile latency (ns) : 20809056036
21-
95.00 percentile latency (ns) : 20809056036
22-
97.00 percentile latency (ns) : 21680382057
23-
99.00 percentile latency (ns) : 21680382057
24-
99.90 percentile latency (ns) : 21680382057
16+
Min latency (ns) : 1351529208
17+
Max latency (ns) : 21435524778
18+
Mean latency (ns) : 11363398709
19+
50.00 percentile latency (ns) : 10941251610
20+
90.00 percentile latency (ns) : 20568919558
21+
95.00 percentile latency (ns) : 20568919558
22+
97.00 percentile latency (ns) : 21435524778
23+
99.00 percentile latency (ns) : 21435524778
24+
99.90 percentile latency (ns) : 21435524778
2525

2626
================================================
2727
Test Parameters Used
@@ -34,9 +34,9 @@ min_duration (ms): 0
3434
max_duration (ms): 0
3535
min_query_count : 1
3636
max_query_count : 500
37-
qsl_rng_seed : 2465351861681999779
38-
sample_index_rng_seed : 14276810075590677512
39-
schedule_rng_seed : 3936089224930324775
37+
qsl_rng_seed : 2085463073848966840
38+
sample_index_rng_seed : 2747215439041700203
39+
schedule_rng_seed : 16159082839903944936
4040
accuracy_log_rng_seed : 0
4141
accuracy_log_probability : 0
4242
accuracy_log_sampling_target : 0

‎open/MLCommons/results/gh_ubuntu-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/performance_console.out‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
User Conf path: /home/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/55960a509d3b463a93a4e20f3b868479.conf
2-
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_2c953200
1+
User Conf path: /home/runner/MLC/repos/amd@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/9815d2a3fce945e4b64e86e03abcc174.conf
2+
Dataset Preprocessed path: /home/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_c6b75339
33
Dataset List filepath:
44
Scenario: Offline
55
Mode: PerformanceOnly

0 commit comments

Comments
 (0)