[feature] Add SGLang HiCacheStorage integration with local and distributed modes#137

Open

staryxchen wants to merge 21 commits into

taco-project:mainfrom

staryxchen:feat/sglang-distributed-mode

Commits on Apr 4, 2026

Commits on Apr 5, 2026

feat(sglang): add distributed mode with cross-node KV Cache sharing via P2P
staryxchen
committed
refactor(sglang): reduce hot-path overhead in HiCacheStorage adapter
staryxchen
committed

Commits on Apr 8, 2026

feat(sglang): layerwise prefetch in HiCacheStorage adapter
staryxchen
committed
fix(sglang): clone blocks in batch_get_v1 to prevent concurrent corruption
staryxchen
committed
feat(sglang): add one-click flexkv-patch-sglang CLI tool
staryxchen
committed

Commits on Apr 10, 2026