Skip to content

[ROCm] Optimize kgemm_4bit_inference_naive for ROCm, use it for batch sizes other than 1#1920

Open
sstamenk wants to merge 1 commit intobitsandbytes-foundation:mainfrom
sstamenk:rocm-4bit-kernel-optimization
Open

[ROCm] Optimize kgemm_4bit_inference_naive for ROCm, use it for batch sizes other than 1#1920
sstamenk wants to merge 1 commit intobitsandbytes-foundation:mainfrom
sstamenk:rocm-4bit-kernel-optimization

Commits