Skip to content

Repro: MTP path on CUDA aborts at fattn.cu:109 (DKQ=512) for Gemma 4 — Blackwell sm_120 + Ampere sm_86#5

Draft
jameseiten wants to merge 1 commit into
AtomicBot-ai:feature/turboquant-kv-cachefrom
jameseiten:bug/mtp-cuda-fattn-DKQ-512-abort
Draft

Repro: MTP path on CUDA aborts at fattn.cu:109 (DKQ=512) for Gemma 4 — Blackwell sm_120 + Ampere sm_86#5
jameseiten wants to merge 1 commit into
AtomicBot-ai:feature/turboquant-kv-cachefrom
jameseiten:bug/mtp-cuda-fattn-DKQ-512-abort

docs: report MTP CUDA fattn.cu:109 abort on Gemma 4 (DKQ=512)

c9dd120
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
labeler
succeeded May 8, 2026 in 12s