Skip to content

Commit 9595fbc

Browse files
mlcommons-botmlcommons-bot
committed
Auto-merge updates from auto-update branch
2 parents b147803 + 20f6645 commit 9595fbc

19 files changed

Lines changed: 433 additions & 434 deletions

File tree

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 6.528 | - |
3+
| resnet50 | offline | 76 | 9.508 | - |

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/README.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ pip install -U mlcflow
1616

1717
mlc rm cache -f
1818

19-
mlc pull repo mlcommons@mlperf-automations --checkout=3b2d1b4ce41dd97aa2c1dfe72e4cc9f003baa1c4
19+
mlc pull repo mlcommons@mlperf-automations --checkout=181f5370c2a2b5d36603ea02dcb61703f619c4b7
2020

2121

2222
```
@@ -40,4 +40,4 @@ Model Precision: fp32
4040
`acc`: `76.0`, Required accuracy for closed division `>= 75.6954`
4141

4242
### Performance Results
43-
`Samples per second`: `6.52808`
43+
`Samples per second`: `9.50807`

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy/mlperf_log_detail.txt‎

Lines changed: 72 additions & 72 deletions
Large diffs are not rendered by default.

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/accuracy_console.out‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
User Conf path: /Users/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/9ad735b3e22840148e9f71de454bee2b.conf
2-
Dataset Preprocessed path: /Users/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_bb99a85f
1+
User Conf path: /Users/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/45704776ca1d4a468df3740021caffb3.conf
2+
Dataset Preprocessed path: /Users/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_d7622ac7
33
Dataset List filepath:
44
Scenario: Offline
55
Mode: AccuracyOnly

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/os_info.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,6 @@
1010
"MLC_HOST_OS_PACKAGE_MANAGER_UPDATE_CMD": "brew update",
1111
"MLC_HOST_PLATFORM_FLAVOR": "arm64",
1212
"MLC_HOST_PYTHON_BITS": "64",
13-
"MLC_HOST_SYSTEM_NAME": "sjc22-bt143-efe9ca08-d5b7-4c7b-b5d5-63f381a7d530-7A0E352579AB.local",
13+
"MLC_HOST_SYSTEM_NAME": "iad20-eo1207-abc754a8-55e4-41e6-86c2-4c56c399aebb-C614B64E5161.local",
1414
"MLC_HOST_FILESYSTEMS": ""
1515
}

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/performance/run_1/mlperf_log_detail.txt‎

Lines changed: 90 additions & 90 deletions
Large diffs are not rendered by default.

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/performance/run_1/mlperf_log_summary.txt‎

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ MLPerf Results Summary
44
SUT name : QueueSUT
55
Scenario : Offline
66
Mode : PerformanceOnly
7-
Samples per second: 6.52808
7+
Samples per second: 9.50807
88
Result is : VALID
99
Min duration satisfied : Yes
1010
Min queries satisfied : Yes
@@ -13,15 +13,15 @@ Result is : VALID
1313
================================================
1414
Additional Stats
1515
================================================
16-
Min latency (ns) : 7948385125
17-
Max latency (ns) : 76592153000
18-
Mean latency (ns) : 44193812532
19-
50.00 percentile latency (ns) : 43977401458
20-
90.00 percentile latency (ns) : 71983616250
21-
95.00 percentile latency (ns) : 76592153000
22-
97.00 percentile latency (ns) : 76592153000
23-
99.00 percentile latency (ns) : 76592153000
24-
99.90 percentile latency (ns) : 76592153000
16+
Min latency (ns) : 4125952750
17+
Max latency (ns) : 52586925791
18+
Mean latency (ns) : 28668075171
19+
50.00 percentile latency (ns) : 27637708875
20+
90.00 percentile latency (ns) : 49316799958
21+
95.00 percentile latency (ns) : 52586925791
22+
97.00 percentile latency (ns) : 52586925791
23+
99.00 percentile latency (ns) : 52586925791
24+
99.90 percentile latency (ns) : 52586925791
2525

2626
================================================
2727
Test Parameters Used

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/performance_console.out‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
1-
User Conf path: /Users/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/45a81e3b93e14870a935dc88a9411bd1.conf
2-
Dataset Preprocessed path: /Users/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_bb99a85f
1+
User Conf path: /Users/runner/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/060fe3654c664310bd83a52df3f7923e.conf
2+
Dataset Preprocessed path: /Users/runner/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_d7622ac7
33
Dataset List filepath:
44
Scenario: Offline
55
Mode: PerformanceOnly

‎open/MLCommons/results/gh_macos-latest_x86-mlcommons_cpp-cpu-onnxruntime-default_config/resnet50/offline/pip_freeze.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@
1818
"requests": "2.33.1",
1919
"setuptools": "82.0.1",
2020
"tabulate": "0.10.0",
21-
"urllib3": "2.6.3",
21+
"urllib3": "2.7.0",
2222
"wheel": "0.47.0"
2323
}
2424
}

‎open/MLCommons/results/gh_ubuntu-latest_x86-reference-cpu-onnxruntime_v1.25.1-default_config/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
| Model | Scenario | Accuracy | Throughput | Latency (in ms) |
22
|----------|------------|------------|--------------|-------------------|
3-
| resnet50 | offline | 76 | 27.86 | - |
3+
| resnet50 | offline | 76 | 27.735 | - |

0 commit comments

Comments
 (0)