Commit 63efa0f
ggml-cpu: extend RVV quantization vec dot to higher VLENs (ggml-org#22754)
* ggml-cpu: add rvv 512b,1024b impls for iq4_xs
* ggml-cpu: refactor; add rvv 512b, 1024b impls for q6_K, i-quants
* ggml-cpu: refactor; add 512 and 1024 implementations of tq3_s, iq3_xxs, iq2_s, iq2_xs, iq2_xxs
improve iq2_xs impl for rvv 256
Co-authored-by: Rehan Qasim <rehan.qasim@10xengineers.ai>
---------
Co-authored-by: taimur-10x <taimur.ahmad@10xengineers.ai>
Co-authored-by: Rehan Qasim <rehan.qasim@10xengineers.ai>
(cherry picked from commit 3c7450c)1 parent d52251e commit 63efa0f
1 file changed
Lines changed: 2969 additions & 926 deletions
0 commit comments