Commit 7d88227
fix(kv-cache): unblock per-side ROT_OVERRIDE knobs (default attn_rot_disable=false)
Previous state: db3595a added LLAMA_ATTN_ROT_K_OVERRIDE / _V_OVERRIDE per-side
opt-in knobs but kept attn_rot_disable defaulting to TRUE for legacy
LLAMA_ATTN_ROT_DISABLE compatibility. The override branches included
`&& !attn_rot_disable` guards, so when LLAMA_ATTN_ROT_DISABLE is unset
(default true) the per-side env knobs were silently no-ops. Users could not
opt into rotation without also setting LLAMA_ATTN_ROT_DISABLE=0.
Fix: flip attn_rot_disable default to false. Rotation is still OFF by default
because attn_rot_k/v default to false. LLAMA_ATTN_ROT_DISABLE=1 still acts as
a hard lock-out that blocks the per-side overrides for users who want a
single switch to guarantee no rotation.
Caught while running the cross-format KLD matrix for the rotation/PPL
investigation paper — V-only override appeared to silently fail. Confirmed
with logs that attn_rot_v stayed 0 even with LLAMA_ATTN_ROT_V_OVERRIDE=1
until this default flip.1 parent 9a8f69e commit 7d88227
1 file changed
Lines changed: 5 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
489 | 489 | | |
490 | 490 | | |
491 | 491 | | |
| 492 | + | |
| 493 | + | |
| 494 | + | |
| 495 | + | |
492 | 496 | | |
493 | | - | |
| 497 | + | |
494 | 498 | | |
495 | 499 | | |
496 | 500 | | |
| |||
0 commit comments