Commit 26b34dc
committed
[None][perf] optimize DSV4 FP8 o_a decode epilogue
Signed-off-by: Mingyang Hao <200044211+mingyangHao@users.noreply.github.com>1 parent 6ce2609 commit 26b34dc
3 files changed
Lines changed: 303 additions & 13 deletions
File tree
- tensorrt_llm/_torch
- custom_ops
- cute_dsl_kernels/blackwell/blockwise_gemm
- tests/unittest/_torch/attention/sparse/deepseek_v4
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3821 | 3821 | | |
3822 | 3822 | | |
3823 | 3823 | | |
| 3824 | + | |
| 3825 | + | |
| 3826 | + | |
3824 | 3827 | | |
3825 | 3828 | | |
3826 | 3829 | | |
| |||
3840 | 3843 | | |
3841 | 3844 | | |
3842 | 3845 | | |
| 3846 | + | |
3843 | 3847 | | |
3844 | 3848 | | |
3845 | 3849 | | |
| |||
3894 | 3898 | | |
3895 | 3899 | | |
3896 | 3900 | | |
| 3901 | + | |
3897 | 3902 | | |
3898 | 3903 | | |
3899 | 3904 | | |
| |||
0 commit comments