Skip to content

Commit 84ffd0c

Browse files
authored
opencl: add flattened Q4_K mv and general Q4_K mm (ggml-org#20773)
1 parent ec2b787 commit 84ffd0c

5 files changed

Lines changed: 733 additions & 0 deletions

File tree

ggml/src/ggml-opencl/CMakeLists.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -89,6 +89,7 @@ set(GGML_OPENCL_KERNELS
8989
mul_mv_q4_1_f32
9090
mul_mv_q4_1_f32_flat
9191
mul_mv_q4_k_f32
92+
mul_mv_q4_k_f32_flat
9293
mul_mv_q6_k_f32
9394
mul_mv_q6_k_f32_flat
9495
mul_mv_q8_0_f32
@@ -107,6 +108,7 @@ set(GGML_OPENCL_KERNELS
107108
mul_mm_q4_0_f32_l4_lm
108109
mul_mm_q4_1_f32_l4_lm
109110
mul_mm_q8_0_f32_l4_lm
111+
mul_mm_q4_k_f32_l4_lm
110112
mul_mm_q6_k_f32_l4_lm
111113
mul_mm_q8_0_f32_8x4
112114
gemv_noshuffle_q4_1_f32

0 commit comments

Comments
 (0)