Commit eeb0154
committed
Optimize mHC for expansion rate 4 using convex combination of permutations and add enable_mhc_k4_shortcut feature gate
1 parent 4d9f390 commit eeb0154
5 files changed
Lines changed: 385 additions & 102 deletions
File tree
- src/maxtext
- configs
- integration/vllm/maxtext_vllm_adapter
- layers
- tests/unit
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1216 | 1216 | | |
1217 | 1217 | | |
1218 | 1218 | | |
| 1219 | + | |
| 1220 | + | |
1219 | 1221 | | |
1220 | 1222 | | |
1221 | 1223 | | |
| |||
0 commit comments