Skip to content

Add k-bit blockwise quantization (K=2-5) with warp-level CUDA kernels #2161

Add k-bit blockwise quantization (K=2-5) with warp-level CUDA kernels

Add k-bit blockwise quantization (K=2-5) with warp-level CUDA kernels #2161

Job Run time
6m 16s
1m 30s
5m 56s
4m 34s
4m 32s
14s
14s
4m 50s
5m 16s
5m 13s
15s
44s
4m 14s
4m 27s
3m 56s
3m 14s
4m 14s
4m 18s
3m 25s
3m 29s
6m 1s
3m 56s
4m 12s
2m 44s
3m 32s
5m 8s
5m 39s
4m 17s
3m 26s
4m 38s
3m 26s
4m 15s
5m 37s
5m 43s
6m 5s
6m 4s
4m 44s
3m 50s
4m 1s
5m 34s
6m 18s
6m 32s
3m 40s
6m 43s
6m 7s
0s
0s
0s
0s
3h 13m 3s