Skip to content

Commit fe3633a

Browse files
committed
Change config to tp4
1 parent 97ca3c1 commit fe3633a

1 file changed

Lines changed: 4 additions & 10 deletions

File tree

.github/configs/amd-master.yaml

Lines changed: 4 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -273,14 +273,11 @@ qwen3.5-fp8-mi355x-sglang:
273273
- isl: 1024
274274
osl: 1024
275275
search-space:
276-
- { tp: 8, ep: 1, conc-start: 4, conc-end: 32 }
277-
- { tp: 8, ep: 8, conc-start: 64, conc-end: 256 }
278-
- { tp: 2, ep: 2, conc-start: 128, conc-end: 256 }
276+
- { tp: 4, ep: 1, conc-start: 4, conc-end: 256 }
279277
- isl: 8192
280278
osl: 1024
281279
search-space:
282-
- { tp: 2, ep: 2, conc-start: 4, conc-end: 32 }
283-
- { tp: 4, ep: 1, conc-start: 32, conc-end: 256 }
280+
- { tp: 4, ep: 1, conc-start: 4, conc-end: 256 }
284281

285282
qwen3.5-fp8-mi355x-sglang-mtp:
286283
image: lmsysorg/sglang-rocm:v0.5.12.post1-rocm720-mi35x-20260528
@@ -295,14 +292,11 @@ qwen3.5-fp8-mi355x-sglang-mtp:
295292
- isl: 1024
296293
osl: 1024
297294
search-space:
298-
- { tp: 8, ep: 1, conc-start: 4, conc-end: 32, spec-decoding: mtp }
299-
- { tp: 8, ep: 8, conc-start: 64, conc-end: 256, spec-decoding: mtp }
300-
- { tp: 2, ep: 2, conc-start: 128, conc-end: 256, spec-decoding: mtp }
295+
- { tp: 4, ep: 1, conc-start: 4, conc-end: 256, spec-decoding: mtp }
301296
- isl: 8192
302297
osl: 1024
303298
search-space:
304-
- { tp: 2, ep: 2, conc-start: 4, conc-end: 32, spec-decoding: mtp }
305-
- { tp: 4, ep: 1, conc-start: 32, conc-end: 256, spec-decoding: mtp }
299+
- { tp: 4, ep: 1, conc-start: 4, conc-end: 256, spec-decoding: mtp }
306300

307301
# Diverged from qwen3.5-fp8-mi355x-sglang (agentic-coding sibling). Metadata is
308302
# identical to origin/main's qwen3.5-fp8-mi355x-sglang; the split exists because this

0 commit comments

Comments
 (0)