Skip to content

Commit 6dbef81

Browse files
seungrokjclaude
andcommitted
[AMD] minimaxm2.5-fp8-mi355x-agentic: increase lmcache DRAM size
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
1 parent c697c16 commit 6dbef81

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

benchmarks/single_node/agentic/minimaxm2.5_fp8_mi355x.sh

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -164,7 +164,10 @@ case "$OFFLOADING" in
164164
# ZMQ endpoint. Bind the server to a raw host, but pass the connector a
165165
# ZMQ-style host string.
166166
LMCACHE_CONNECT_HOST="${LMCACHE_CONNECT_HOST:-tcp://$LMCACHE_HOST}"
167-
LMCACHE_L1_SIZE_GB="${LMCACHE_L1_SIZE_GB:-$((TOTAL_CPU_DRAM_GB / (8 / TP)))}"
167+
#LMCACHE_L1_SIZE_GB="${LMCACHE_L1_SIZE_GB:-$((TOTAL_CPU_DRAM_GB / (8 / TP)))}"
168+
# (srok)TODO: intentionally increased DRAM size
169+
TOTAL_CPU_DRAM_GB=2000
170+
LMCACHE_L1_SIZE_GB="${LMCACHE_L1_SIZE_GB:-$((TOTAL_CPU_DRAM_GB))}"
168171
LMCACHE_L1_INIT_SIZE_GB="${LMCACHE_L1_INIT_SIZE_GB:-20}"
169172
# LMCache read locks are leases on chunks that lookup has promised
170173
# vLLM can retrieve. The default 300s TTL is too short for this

0 commit comments

Comments
 (0)