Commit 3b921a7
Free the CUDA context on Gpu drop (fix cuCtxCreate OOM)
Gpu had no Drop impl, so every finished fragment leaked its CUDA context
and loaded module. Each context reserves a few hundred MB of device
memory, so after a few dozen fragments cuCtxCreate started failing with
"out of memory" and the worker spun claiming fragments it could never
run.
Add Drop for Gpu (cuModuleUnload + cuCtxDestroy) and drop the now-stale
allow(dead_code) on the ctx field. Add an ignore-gated GPU regression
test that creates/drops a Gpu 64 times: it passes with the fix and dies
at iteration ~56 with the exact OOM without it. Bump version to 0.1.7.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>1 parent 64a0be6 commit 3b921a7
3 files changed
Lines changed: 47 additions & 3 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
| 36 | + | |
36 | 37 | | |
37 | 38 | | |
38 | 39 | | |
| |||
120 | 121 | | |
121 | 122 | | |
122 | 123 | | |
123 | | - | |
124 | 124 | | |
125 | 125 | | |
126 | 126 | | |
| |||
207 | 207 | | |
208 | 208 | | |
209 | 209 | | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
| 223 | + | |
210 | 224 | | |
211 | 225 | | |
212 | 226 | | |
| |||
307 | 321 | | |
308 | 322 | | |
309 | 323 | | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
| 342 | + | |
| 343 | + | |
| 344 | + | |
| 345 | + | |
| 346 | + | |
| 347 | + | |
| 348 | + | |
| 349 | + | |
| 350 | + | |
| 351 | + | |
| 352 | + | |
| 353 | + | |
0 commit comments