Skip to content

Commit 9f8a34d

Browse files
committed
Update on "[executorch] show backend test infra pass rate of CUDA backend to PyTorch HUD"
Add infrastructure to track CUDA backend test pass rates on PyTorch HUD dashboard over time Differential Revision: [D95335059](https://our.internmc.facebook.com/intern/diff/D95335059/) [ghstack-poisoned]
2 parents 1e3cc63 + 853faa3 commit 9f8a34d

2 files changed

Lines changed: 10 additions & 1 deletion

File tree

.ci/scripts/generate_test_pass_rate_in_v3_format.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -171,7 +171,9 @@ def main():
171171
)
172172

173173
print(f"Suite: {args.suite}")
174-
print(f" Pass: {counts['passes']}, Fail: {counts['fails']}, Skip: {counts['skips']}")
174+
print(
175+
f" Pass: {counts['passes']}, Fail: {counts['fails']}, Skip: {counts['skips']}"
176+
)
175177
print(f" Pass rate: {pass_rate:.2f}%")
176178

177179
records = generate_v3_records(

.github/workflows/test-backend-cuda.yml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -81,6 +81,13 @@ jobs:
8181
echo "V3 results prepared:"
8282
ls -lah benchmark-results/v3/ || echo "No v3 results generated"
8383
84+
- name: Authenticate with AWS
85+
uses: aws-actions/configure-aws-credentials@v4
86+
with:
87+
role-to-assume: arn:aws:iam::308535385114:role/gha_workflow_upload-benchmark-results
88+
role-duration-seconds: 18000
89+
aws-region: us-east-1
90+
8491
- name: Upload test pass rate to dashboard
8592
uses: pytorch/test-infra/.github/actions/upload-benchmark-results@main
8693
with:

0 commit comments

Comments
 (0)