Commit d22c215
committed
server: clear checkpoints on context shift to prevent stale restore faults
After context shift, slot.prompt.checkpoints retained pre-shift positions.
Subsequent checkpoint restore via llama_state_seq_set_data_ext used stale
positions causing GPU memory access faults on multi-GPU ROCm setups.1 parent 98cf181 commit d22c215
1 file changed
Lines changed: 1 addition & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2257 | 2257 | | |
2258 | 2258 | | |
2259 | 2259 | | |
| 2260 | + | |
2260 | 2261 | | |
2261 | 2262 | | |
2262 | 2263 | | |
| |||
0 commit comments