Skip to content

xplat/executorch/oss/.ci/scripts/benchmark_tooling/analyze_benchmark_stability.py #3108

xplat/executorch/oss/.ci/scripts/benchmark_tooling/analyze_benchmark_stability.py

xplat/executorch/oss/.ci/scripts/benchmark_tooling/analyze_benchmark_stability.py #3108

Triggered via pull request April 23, 2026 18:45
Status Success
Total duration 31m 10s
Artifacts 3

test-backend-qnn.yml

on: pull_request
Matrix: test-qnn / test-backend-linux
Matrix: test-qnn / test-backend-macos
Waiting for pending jobs
test-qnn  /  package-golden-artifacts
2m 21s
test-qnn / package-golden-artifacts
Fit to window
Zoom out
Zoom in

Annotations

3 warnings
test-qnn / test-backend-linux (qnn, operators) / linux-job
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: ./test-infra/.github/actions/setup-ssh, actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683, actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02, pmeier/pytest-results-action@a2c1430e2bddadbad9f49a6f9b879f062c6b19b1. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
test-qnn / test-backend-linux (qnn, models) / linux-job
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: ./test-infra/.github/actions/setup-ssh, actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683, actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02, pmeier/pytest-results-action@a2c1430e2bddadbad9f49a6f9b879f062c6b19b1. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
test-qnn / package-golden-artifacts
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/download-artifact@v4, actions/upload-artifact@v4, seemethere/upload-artifact-s3@v5. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
golden-artifacts-qnn
868 MB
sha256:a14fc5442230c46a7a7055cec7f7a99e61a08b2a99b2d9a33a2dacacb309f88d
test-report-qnn-models
869 MB
sha256:e3b2a7c363e26bafd0c5f7b11d3bd9dd6da2e6bb86c2807942ec7f5d08b3f6f1
test-report-qnn-operators
1.18 MB
sha256:705092951d61f9591da4196cf9858b8fd32a22ca74d7d295e2d0192b1a4bf91f