Commit bb205f8
[AMD][AgentX] kimik2.7 TP8 3600s: none c[4,8], lmcache+mooncake c[16,32,48]; fix Mooncake worker import
Reshape the TP8 agentic sweep for the real 3600s comparison run:
- none (GPU-only) swept only at low conc [4,8] (it collapses under load)
- LMCache and Mooncake carry the high-conc [16,32,48] range
- duration 3600s (the prior 900s smoke was warmup-dominated for the
~90k-token agentic inputs, so per-request metrics were unreliable)
Fix Mooncake so the vLLM worker subprocesses can import it: the previous
bare `make install` only laid down C++ libs, so the launcher imported
`mooncake` but the workers hit "Please install mooncake ..." at KV-cache
init. Build the wheel via Mooncake's scripts/build_wheel.sh (auditwheel
bundles every .so) and pip install it into site-packages, and build with
-DWITH_STORE=ON so store.so (MooncakeStoreConnector) is present.
Drop the temporary configs/smoke-kimik2.7-mooncake.yaml overlay; all three
backends now run from one canonical config.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>1 parent 9fa02ce commit bb205f8
3 files changed
Lines changed: 22 additions & 26 deletions
File tree
- benchmarks/single_node/agentic
- configs
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
211 | 211 | | |
212 | 212 | | |
213 | 213 | | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
214 | 221 | | |
215 | 222 | | |
216 | 223 | | |
| 224 | + | |
| 225 | + | |
217 | 226 | | |
218 | 227 | | |
219 | 228 | | |
220 | 229 | | |
221 | 230 | | |
222 | 231 | | |
223 | | - | |
| 232 | + | |
224 | 233 | | |
225 | | - | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
| 238 | + | |
226 | 239 | | |
227 | 240 | | |
228 | 241 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
558 | 558 | | |
559 | 559 | | |
560 | 560 | | |
561 | | - | |
562 | | - | |
563 | | - | |
564 | | - | |
| 561 | + | |
| 562 | + | |
| 563 | + | |
| 564 | + | |
| 565 | + | |
565 | 566 | | |
566 | | - | |
| 567 | + | |
567 | 568 | | |
568 | | - | |
| 569 | + | |
569 | 570 | | |
570 | 571 | | |
571 | 572 | | |
| |||
This file was deleted.
0 commit comments