Skip to content

[TRTLLM-12499][feat] (WIP) Add support for pipelined KVCache transfer for disaggregated serving in Python Cache Transceiver#15727

Open
athena-nv wants to merge 10 commits into
NVIDIA:mainfrom
athena-nv:trtllm-12499-pipelined-kvcache-transfer
Open

[TRTLLM-12499][feat] (WIP) Add support for pipelined KVCache transfer for disaggregated serving in Python Cache Transceiver#15727
athena-nv wants to merge 10 commits into
NVIDIA:mainfrom
athena-nv:trtllm-12499-pipelined-kvcache-transfer

Add integration accuracy test, and remove cuda_event from KVSlice

7705b98
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jun 29, 2026 in 1s

DCO

All commits are signed off!