[KVCache][Feature] Implement Cache Manager V1 Storage Transfer and Prefetch (2/n)#7529

Open

kevincheng2 wants to merge 37 commits into

PaddlePaddle:developfrom

kevincheng2:feature/cache_manager_storage_transfer

Commits on May 11, 2026

Update cache manager and related modules

kevincheng2
and
claude
committed
chore: update cache_manager and related modules

kevincheng2
and
claude
committed
fix: add node to evictable set in complete_swap_to_device

kevincheng2
and
claude
committed
feat: update cache manager v1 and related modules

kevincheng2
and
claude
committed
feat(cache): add cache controller v1 implementation
kevincheng2
committed
feat(cache_manager): update cache manager v1
kevincheng2
committed
fix(cache_manager): 修复 swap_cache H2D/D2H 方向的 block_ids 逻辑并清理 ForwardMeta

kevincheng2
and
claude
committed
feat(cache_manager): refactor cache manager v1 and optimize swap ops
kevincheng2
committed
[KVCache][MTP] 支持 cache_manager_v1 下的 MTP KV Cache 初始化及多模态 hash
kevincheng2
committed
fix(cache_manager): multi-GPU fix, mm hash boundary fix, and remove batch ops

kevincheng2
and
claude
committed
[BugFix][KVCache] fix List import and move write_policy normalization to CacheManager

kevincheng2
and
claude
committed
[BugFix][KVCache] fix pre-commit code style issues

kevincheng2
and
claude
committed
[Feature][KVCache] update cache_manager_v1 modules

kevincheng2
and
claude
committed
[Feature][KVCache] add BatchRequest.from_tasks and refactor worker task parsing

kevincheng2
and
claude
committed
[Feature][KVCache] add NUMA affinity for host cache and skip swap cache tests

kevincheng2
and
claude
committed
[BugFix][KVCache] remove debug logging code

kevincheng2
and
claude
committed
[BugFix][KVCache] fix cupy device id caching and pickle for _match_result
kevincheng2
committed
[Feature][KVCache] update cache_manager_v1 transfer and storage modules

kevincheng2
and
claude
committed
[KVCache] implement storage prefetch/backup and D2H→Storage chaining in CacheController

kevincheng2
and
claude
committed
[KVCache] remove unused elapsed_put_s variable in mooncake connector

kevincheng2
and
claude
committed
[KVCache] refactor transfer_manager and add staging_manager

kevincheng2
and
claude
committed
[KVCache][Feature] implement storage prefetch ZMQ pipeline in Scheduler and Worker
kevincheng2
committed
sync: align all core files with upstream/develop

kevincheng2
and
claude
committed
Revert "sync: align all core files with upstream/develop"
kevincheng2
committed
fix: remove IPCLock and add missing attrs to align with upstream
kevincheng2
committed
feat: refactor storage prefetch - 3-phase architecture

kevincheng2
and
claude
committed
[KVCache][Engine] fix has_pending_work and move swap/evict to worker layer

kevincheng2
and
claude
committed
[KVCache][Engine][OP] cache manager v1 refactor, engine fixes and new unit tests

kevincheng2
and
claude
committed
[KVCache][Engine][BugFix] fix cache evict metadata direction and resource manager v1 bugs

kevincheng2
and
claude
committed
[KVCache][BugFix] fix increment ref count logic in cache_manager

kevincheng2
and
claude
committed
[KVCache] unify host block allocation through allocate_host_blocks
kevincheng2
committed
[KVCache][Scheduler] disable write_cache_to_storage* calls under cache manager v1
kevincheng2
committed
[KVCache][BugFix] fix storage prefetch nodes inserted at wrong radix tree position
kevincheng2
committed
fix: pre-commit fixes for test_mm_warmup.py imports and formatting
kevincheng2
committed
fix: move get_position_ids_and_mask_encoder_batch to non-iluvatar import path
kevincheng2
committed

Commits on May 12, 2026

refactor: remove staging_manager, update transfer and storage connector
kevincheng2
committed

Commits on May 13, 2026

refactor: simplify storage interface to batch-only, fix prefetch ref_count and add debug logging
kevincheng2
committed