Commit 73d8740

Sven

authored

Add SeerAttention and SlimAttention Paper (#135)

* Add slim-attention: transform KV-cache to K cache only Signed-off-by: sven <svenzhang@live.com> * Add SeerAttention: learnable sparse attention like NSA(deepseek) MoBA Signed-off-by: sven <svenzhang@live.com> --------- Signed-off-by: sven <svenzhang@live.com>

1 parent 8a0ae90 commit 73d8740Copy full SHA for 73d8740

1 file changed

README.md

Comments

(0)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Commit 73d8740

File tree

0 commit comments