Commit 8f5e152
committed
fix: remove device printf from GDN kernel — corrupts output on Blackwell SM 12.0
The debug printf inside gated_delta_net_step (added in cf54a0b) causes
garbage output on Blackwell GPUs. Device printf on SM 12.0 appears to
corrupt the kernel's register state or introduce synchronization
artifacts, producing blank lines, repeated characters, or echoed
prompt templates instead of coherent text.
Also reverts the kh_mode parameter to the simpler division-only
formula (head_id / k_heads_per_v) since the MLX format is the only
one used on the CUDA backend.
Verified: 'The capital of France is' → 'Paris' on both RTX 4090
(SM 8.9) and RTX PRO 6000 Blackwell (SM 12.0).1 parent c8219ac commit 8f5e152
2 files changed
Lines changed: 3 additions & 15 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1940 | 1940 | | |
1941 | 1941 | | |
1942 | 1942 | | |
1943 | | - | |
1944 | 1943 | | |
1945 | 1944 | | |
1946 | 1945 | | |
1947 | 1946 | | |
1948 | 1947 | | |
1949 | 1948 | | |
1950 | | - | |
| 1949 | + | |
1951 | 1950 | | |
1952 | 1951 | | |
1953 | 1952 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
731 | 731 | | |
732 | 732 | | |
733 | 733 | | |
734 | | - | |
735 | | - | |
| 734 | + | |
736 | 735 | | |
737 | 736 | | |
738 | 737 | | |
739 | 738 | | |
740 | 739 | | |
741 | 740 | | |
742 | | - | |
743 | | - | |
| 741 | + | |
744 | 742 | | |
745 | 743 | | |
746 | 744 | | |
| |||
767 | 765 | | |
768 | 766 | | |
769 | 767 | | |
770 | | - | |
771 | | - | |
772 | | - | |
773 | | - | |
774 | | - | |
775 | | - | |
776 | | - | |
777 | | - | |
778 | | - | |
779 | 768 | | |
780 | 769 | | |
781 | 770 | | |
| |||
0 commit comments