Skip to content

[no-ci] Reduce nightly test repetitions from 100 to 5#1991

Merged
leofang merged 1 commit intomainfrom
reduce-nightly-nruns
Apr 29, 2026
Merged

[no-ci] Reduce nightly test repetitions from 100 to 5#1991
leofang merged 1 commit intomainfrom
reduce-nightly-nruns

Conversation

@leofang
Copy link
Copy Markdown
Member

@leofang leofang commented Apr 29, 2026

The nightly schedule (cron: "0 0 * * *") sets nruns: 100, which passes --count=100 to pytest — every test is repeated 100 times. Combined with the full PR test matrix (~60 configurations across linux-64, linux-aarch64, and win-64), this causes 6–12 hour runtimes that saturate the runner queue and block daytime PR CI.

Our nightly CI has never been able to finish, nor is it ever green:
https://github.com/NVIDIA/cuda-python/actions/workflows/ci.yml?query=event%3Aschedule

This PR reduces nruns from 100 to 5 for all three test platform jobs. Five repetitions still surface flaky tests while cutting nightly runtime by ~20×.

-- Leo's bot

The nightly schedule runs every test 100x (via pytest --count) across
~60 matrix configurations on 3 platforms, causing 6-12 hour runtimes
that block the runner queue for PR CI during the day. 5 repetitions
still provide useful flaky-test signal without monopolizing runners.

Co-Authored-By: Leo's bot <noreply@github.com>
@copy-pr-bot
Copy link
Copy Markdown
Contributor

copy-pr-bot Bot commented Apr 29, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions Bot added the CI/CD CI/CD infrastructure label Apr 29, 2026
@leofang leofang requested review from kkraus14 and rparolin April 29, 2026 21:29
@leofang leofang added the P0 High priority - Must do! label Apr 29, 2026
@leofang leofang self-assigned this Apr 29, 2026
@leofang leofang added this to the cuda.core v1.0.0 milestone Apr 29, 2026
@leofang leofang changed the title Reduce nightly test repetitions from 100 to 5 [no-ci] Reduce nightly test repetitions from 100 to 5 Apr 29, 2026
@leofang
Copy link
Copy Markdown
Member Author

leofang commented Apr 29, 2026

/ok to test 851df39

@leofang leofang enabled auto-merge (squash) April 29, 2026 21:32
@leofang leofang merged commit 20f9a54 into main Apr 29, 2026
24 of 25 checks passed
@leofang leofang deleted the reduce-nightly-nruns branch April 29, 2026 21:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI/CD CI/CD infrastructure P0 High priority - Must do!

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants