Skip to content

Commit af1127d

Browse files
authored
opencl: add basic support for q5_k (ggml-org#21593)
* opencl: add general q5_k mv * opencl: add flattened Q5_K mv and general Q5_K mm * opencl: fix Q5_K unit tests
1 parent 865ff06 commit af1127d

File tree

6 files changed

+1043
-2
lines changed

6 files changed

+1043
-2
lines changed

ggml/src/ggml-opencl/CMakeLists.txt

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -90,6 +90,8 @@ set(GGML_OPENCL_KERNELS
9090
mul_mv_q4_1_f32_flat
9191
mul_mv_q4_k_f32
9292
mul_mv_q4_k_f32_flat
93+
mul_mv_q5_k_f32
94+
mul_mv_q5_k_f32_flat
9395
mul_mv_q6_k_f32
9496
mul_mv_q6_k_f32_flat
9597
mul_mv_q8_0_f32
@@ -109,6 +111,7 @@ set(GGML_OPENCL_KERNELS
109111
mul_mm_q4_1_f32_l4_lm
110112
mul_mm_q8_0_f32_l4_lm
111113
mul_mm_q4_k_f32_l4_lm
114+
mul_mm_q5_k_f32_l4_lm
112115
mul_mm_q6_k_f32_l4_lm
113116
mul_mm_q8_0_f32_8x4
114117
gemv_noshuffle_q4_1_f32

0 commit comments

Comments
 (0)