Skip to content

fix(build): cap default build parallelism by available memory to prevent OOM (#8873) - #8875

Merged
mc-nv merged 1 commit into
r26.07from
mchornyi/TRI-1550/cp-oom
Jul 8, 2026
Merged

fix(build): cap default build parallelism by available memory to prevent OOM (#8873)#8875
mc-nv merged 1 commit into
r26.07from
mchornyi/TRI-1550/cp-oom

Conversation

@mc-nv

@mc-nv mc-nv commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

What does the PR do?

Cherry-pick of #8873 to r26.07.

Caps the default build.py parallelism (multiprocessing.cpu_count() * 2
memory-aware, affinity-aware) so fully-uncached builds no longer OOM the GitLab runner
hosts. No functional differences from the original; clean cherry-pick.

Related PRs:

triton-inference-server/onnxruntime_backend#349

Related Issues:

  • Relates to: TRI-1550

@mc-nv
mc-nv merged commit 7e0aa5e into r26.07 Jul 8, 2026
3 checks passed
@mc-nv
mc-nv deleted the mchornyi/TRI-1550/cp-oom branch July 8, 2026 21:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

3 participants