Commit 37159cd
committed
Fix BOS zeroing in TextLLMRunner::prefill for skipped inputs
Only zero num_bos/num_eos after actually processing a text input,
not after skipping a non-text input. Previously, if a non-text input
preceded a text input, the BOS would be lost.
This PR was authored with the assistance of Claude.1 parent e0ee4dc commit 37159cd
1 file changed
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
260 | 260 | | |
261 | 261 | | |
262 | 262 | | |
| 263 | + | |
| 264 | + | |
263 | 265 | | |
264 | 266 | | |
265 | | - | |
266 | | - | |
267 | 267 | | |
268 | 268 | | |
269 | 269 | | |
| |||
0 commit comments