[TENT] Proxy manager performance optimization#2091

alogfans wants to merge 6 commits into

kvcache-ai:mainkvcache-ai/Mooncake:mainfrom

alogfans:proxy-manager-performance-optimizationalogfans/Mooncake:proxy-manager-performance-optimizationCopy head branch name to clipboard