Add k-bit blockwise quantization (K=2-5) with warp-level CUDA kernels #2161
| Job | Run time |
|---|---|
| 6m 16s | |
| 1m 30s | |
| 5m 56s | |
| 4m 34s | |
| 4m 32s | |
| 14s | |
| 14s | |
| 4m 50s | |
| 5m 16s | |
| 5m 13s | |
| 15s | |
| 44s | |
| 4m 14s | |
| 4m 27s | |
| 3m 56s | |
| 3m 14s | |
| 4m 14s | |
| 4m 18s | |
| 3m 25s | |
| 3m 29s | |
| 6m 1s | |
| 3m 56s | |
| 4m 12s | |
| 2m 44s | |
| 3m 32s | |
| 5m 8s | |
| 5m 39s | |
| 4m 17s | |
| 3m 26s | |
| 4m 38s | |
| 3m 26s | |
| 4m 15s | |
| 5m 37s | |
| 5m 43s | |
| 6m 5s | |
| 6m 4s | |
| 4m 44s | |
| 3m 50s | |
| 4m 1s | |
| 5m 34s | |
| 6m 18s | |
| 6m 32s | |
| 3m 40s | |
| 6m 43s | |
| 6m 7s | |
| 0s | |
| 0s | |
| 0s | |
| 0s | |
| 3h 13m 3s |