[Feature][KVCache] Implement Cache Manager V1 with GPU + CPU Cache Support (1/n)#7097

Merged

Jiang-Jia-Jun merged 32 commits into

PaddlePaddle:developfrom

kevincheng2:feature/cache_manager_v1_rebase

Apr 21, 2026

Commits on Apr 14, 2026

[Feature][KVCache] Support cache manager v1 architecture

kevincheng2
and
claude
committed
Update cache manager and related modules

kevincheng2
and
claude
committed
chore: update cache_manager and related modules

kevincheng2
and
claude
committed
fix: add node to evictable set in complete_swap_to_device

kevincheng2
and
claude
committed
feat: update cache manager v1 and related modules

kevincheng2
and
claude
committed
feat(cache): add cache controller v1 implementation
kevincheng2
committed
feat(cache_manager): update cache manager v1
kevincheng2
committed
fix(cache_manager): 修复 swap_cache H2D/D2H 方向的 block_ids 逻辑并清理 ForwardMeta

kevincheng2
and
claude
committed
feat(cache_manager): refactor cache manager v1 and optimize swap ops
kevincheng2
committed
[KVCache][MTP] 支持 cache_manager_v1 下的 MTP KV Cache 初始化及多模态 hash
kevincheng2
committed
fix(cache_manager): multi-GPU fix, mm hash boundary fix, and remove batch ops

kevincheng2
and
claude
committed
[BugFix][KVCache] fix List import and move write_policy normalization to CacheManager

kevincheng2
and
claude
committed
[BugFix][KVCache] fix pre-commit code style issues

kevincheng2
and
claude
committed
[Feature][KVCache] update cache_manager_v1 modules

kevincheng2
and
claude
committed
[Feature][KVCache] add BatchRequest.from_tasks and refactor worker task parsing

kevincheng2
and
claude
committed
[Feature][KVCache] add NUMA affinity for host cache and skip swap cache tests

kevincheng2
and
claude
committed
[BugFix][KVCache] fix unittest failures for cache_manager_v1

kevincheng2
and
claude
committed
[BugFix][KVCache] remove debug logging code

kevincheng2
and
claude
committed
[BugFix][KVCache] fix cupy device id caching and pickle for _match_result
kevincheng2
committed
fix(test): fix unit test errors for _trigger_preempt and wakeup with MTP

kevincheng2
and
claude
committed
[BugFix][KVCache] fix gpu_free_block_list returning wrong block IDs

kevincheng2
and
claude
committed
[BugFix][KVCache] 修复 gpu_free_block_list 返回 int 导致 TypeError

kevincheng2
and
claude
committed
[KVCache][CacheManager] 适配 V1 CacheManager 的 pause/sleep/free_cache 操作
 kevincheng2
committed
[BugFix][KVCache] fix missing enable_cache_manager_v1 in test mocks and remove unused select_blocks_for_backup

kevincheng2
and
claude
committed
[BugFix][KVCache] simplify _free_blocks in ResourceManagerV1 for non-v1 path

kevincheng2
and
claude
committed

Commits on Apr 15, 2026

[KVCache][Optimization][BugFix] fix and optimize block_pool, cache_manager, transfer_manager, request
kevincheng2
committed

Commits on Apr 16, 2026

Commits on Apr 19, 2026

Merge branch 'develop' into feature/cache_manager_v1_rebase
Jiang-Jia-Jun
authored

Commits on Apr 20, 2026

Commits on Apr 21, 2026

Merge branch 'develop' into feature/cache_manager_v1_rebase
kevincheng2
authored