Commit eb84c58
Bhanu Teja Goshikonda
fix(pytorch): reduce 2.13 GPU max_jobs to 4 to fit wheel-export in RAM
The wheel-cache upload path in
scripts/ci/build/pytorch_runtime/lib/upload_wheels.sh runs
`docker buildx build --target wheel-export`, which re-executes the
entire Dockerfile to reach a scratch stage that COPYs the built wheels
out of the flash-attn and TE builder stages. With MAX_JOBS=8, the
concurrent flash-attn 2.8.3 + transformer-engine 2.16.1 source builds
during that re-execution exceed the CI runner cgroup memory limit and
get OOM-killed (SIGKILL / exit code 137, PR #6365 attempt 2).
Halving MAX_JOBS to 4 roughly halves peak compile RAM, keeping the
re-execution under the runner ceiling at the cost of a slower flash-attn
/ TE compile step. CPU configs unaffected.1 parent bef8cb8 commit eb84c58
2 files changed
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
26 | 26 | | |
27 | 27 | | |
28 | 28 | | |
29 | | - | |
| 29 | + | |
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
30 | | - | |
| 30 | + | |
31 | 31 | | |
32 | 32 | | |
33 | 33 | | |
| |||
0 commit comments