Skip to content

Add DRAM KV offloading (HiCache) to GLM-5.2 NVFP4 B300 SGLang agentic recipe#2279

Merged
Oseltamivir merged 3 commits into
mainfrom
add-glm5.2-b300-agentic-hicache
Jul 19, 2026
Merged

Add DRAM KV offloading (HiCache) to GLM-5.2 NVFP4 B300 SGLang agentic recipe#2279
Oseltamivir merged 3 commits into
mainfrom
add-glm5.2-b300-agentic-hicache

fix: ratio-based HiCache sizing (0.75) for DSA-family GLM-5.2

dc3a492
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar