Skip to content

Commit 2af7377

Browse files
committed
manual
Signed-off-by: seungrokj <seungrok.jung@amd.com>
1 parent c050d08 commit 2af7377

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

benchmarks/single_node/agentic/kimik2.5_fp4_mi355x.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -521,6 +521,7 @@ case "$OFFLOADING" in
521521
LMCACHE_CHUNK_SIZE="${LMCACHE_CHUNK_SIZE:-256}"
522522
LMCACHE_MAX_WORKERS="${LMCACHE_MAX_WORKERS:-$TP}"
523523
export PYTHONHASHSEED="${PYTHONHASHSEED:-0}"
524+
export LMCACHE_BLOCKING_TIMEOUT_SECS=60
524525

525526
echo "Starting LMCache MP server..."
526527
LMCACHE_CMD=(

0 commit comments

Comments
 (0)