[AMD][AgentX] Move Kimi-K2.7 agentic sweep to TP8 conc[16,32,48] 900s smoke

At TP4 the conc16/32 cells were GPU-KV-capacity bound: the ~121 GiB KV
pool held only ~12 resident ~90k-token contexts, so throughput plateaued
(~160 tok/s) and requests preempted/thrashed from conc16 up (0 preemptions
at c8, 24 at c16, 35 at c32). LMCache was healthy (82% external prefix-hit)
so offload quality was not the limiter -- raw resident-KV room was.

Move the agentic-coding sweep to TP8 (doubles the KV pool and per-token
decode compute) at conc [16,32,48] for both KV-offloading none and
dram/LMCache, as a 900s trace-replay smoke.

Adds an optional per-scenario `duration` override to the agentic-coding
config schema (defaults to 3600s when unset) so smoke sweeps can run
shorter without changing the global default.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Author: hyukjlee

configs/amd-master.yaml

@@ -558,10 +558,15 @@ kimik2.7-fp4-mi355x-vllm-agentic:
   multinode: false
   scenarios:
     agentic-coding:
+    # TP8 900s smoke to break the TP4 GPU-KV-capacity wall at higher concurrency.
+    # At TP4 the ~121 GiB KV pool held only ~12 resident ~90k-token contexts, so
+    # throughput plateaued (~160 tok/s) and preemption thrashed from conc16 up.
+    # TP8 doubles GPUs -> ~2x KV pool + faster per-token decode.
     - dram-utilization: 0.80
+      duration: 900
       search-space:
-      - { tp: 4, kv-offloading: none, conc-list: [1, 4, 8] }
-      - { tp: 4, kv-offloading: dram, kv-offload-backend: { name: lmcache, version: "aaf7c0d3" }, conc-list: [16, 32] }
+      - { tp: 8, kv-offloading: none, conc-list: [16, 32, 48] }
+      - { tp: 8, kv-offloading: dram, kv-offload-backend: { name: lmcache, version: "aaf7c0d3" }, conc-list: [16, 32, 48] }
 
 
 kimik2.5-fp4-mi355x-atom:

utils/matrix_logic/generate_sweep_configs.py

@@ -700,7 +700,7 @@ def generate_full_sweep(args, all_config_data, runner_data):
 
         for agentic_config in agentic_configs:
             bmk_space = agentic_config[Fields.SEARCH_SPACE.value]
-            duration = DEFAULT_AGENTIC_DURATION_SECONDS
+            duration = agentic_config.get(Fields.DURATION.value) or DEFAULT_AGENTIC_DURATION_SECONDS
 
             for bmk in bmk_space:
                 if is_multinode:
@@ -1003,7 +1003,7 @@ def generate_test_config_sweep(args, all_config_data, runner_data=None):
         # ---- Agentic-coding scenarios ----
         agentic_configs = val[Fields.SCENARIOS.value].get(Fields.AGENTIC_CODING.value, []) if (scenario_filter is None or 'agentic-coding' in scenario_filter) else []
         for agentic_config in agentic_configs:
-            duration = DEFAULT_AGENTIC_DURATION_SECONDS
+            duration = agentic_config.get(Fields.DURATION.value) or DEFAULT_AGENTIC_DURATION_SECONDS
             bmk_space = agentic_config[Fields.SEARCH_SPACE.value]
 
             for bmk in bmk_space:

utils/matrix_logic/test_validation.py

@@ -575,10 +575,33 @@ def test_available_cpu_dram_is_not_a_master_config_field(self):
                 }],
             })
 
-    def test_duration_is_not_a_master_config_field(self):
+    def test_duration_is_an_optional_master_config_field(self):
+        # Per-scenario duration override (falls back to the default 3600s in the
+        # sweep generator when unset). Used for shorter agentic smoke sweeps.
+        cfg = AgenticCodingConfig(**{
+            "duration": 1800,
+            "search-space": [{
+                "tp": 8,
+                "kv-offloading": "none",
+                "conc-list": [16],
+            }],
+        })
+        assert cfg.duration == 1800
+
+    def test_duration_defaults_to_none_when_unset(self):
+        cfg = AgenticCodingConfig(**{
+            "search-space": [{
+                "tp": 8,
+                "kv-offloading": "none",
+                "conc-list": [16],
+            }],
+        })
+        assert cfg.duration is None
+
+    def test_duration_must_be_positive(self):
         with pytest.raises(Exception, match="duration"):
             AgenticCodingConfig(**{
-                "duration": 1800,
+                "duration": 0,
                 "search-space": [{
                     "tp": 8,
                     "kv-offloading": "none",

utils/matrix_logic/validation.py

@@ -638,6 +638,11 @@ class AgenticCodingConfig(BaseModel):
     dram_utilization: Optional[float] = Field(
         default=None, alias=Fields.DRAM_UTILIZATION.value, gt=0, le=1
     )
+    # Per-scenario trace-replay duration override (seconds). Falls back to
+    # DEFAULT_AGENTIC_DURATION_SECONDS in the sweep generator when unset.
+    duration: Optional[int] = Field(
+        default=None, alias=Fields.DURATION.value, gt=0
+    )
 
     @model_validator(mode='after')
     def validate_dram_offload_capacity(self):