Skip to content

Commit 7daaa8b

Browse files
Add conc 128 to gptoss mi355 tp1 vllm and b200 tp1/tp2 (#209)
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
1 parent 45ae064 commit 7daaa8b

2 files changed

Lines changed: 9 additions & 9 deletions

File tree

.github/configs/amd-master.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -154,18 +154,18 @@ gptoss-fp4-mi355x-vllm:
154154
- isl: 1024
155155
osl: 1024
156156
search-space:
157-
- { tp: 1, conc-start: 4, conc-end: 64 }
157+
- { tp: 1, conc-start: 4, conc-end: 128 }
158158
- { tp: 4, conc-start: 4, conc-end: 8 }
159159
- { tp: 8, conc-start: 4, conc-end: 16 }
160160
- isl: 1024
161161
osl: 8192
162162
search-space:
163-
- { tp: 1, conc-start: 4, conc-end: 64 }
163+
- { tp: 1, conc-start: 4, conc-end: 128 }
164164
- { tp: 4, conc-start: 4, conc-end: 8 }
165165
- { tp: 8, conc-start: 4, conc-end: 16 }
166166
- isl: 8192
167167
osl: 1024
168168
search-space:
169-
- { tp: 1, conc-start: 4, conc-end: 64 }
169+
- { tp: 1, conc-start: 4, conc-end: 128 }
170170
- { tp: 4, conc-start: 4, conc-end: 4 }
171171
- { tp: 8, conc-start: 4, conc-end: 8 }

.github/configs/nvidia-master.yaml

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -208,22 +208,22 @@ gptoss-fp4-b200-vllm:
208208
- isl: 1024
209209
osl: 1024
210210
search-space:
211-
- { tp: 1, conc-start: 4, conc-end: 64 }
212-
- { tp: 2, conc-start: 4, conc-end: 64 }
211+
- { tp: 1, conc-start: 4, conc-end: 128 }
212+
- { tp: 2, conc-start: 4, conc-end: 128 }
213213
- { tp: 4, conc-start: 4, conc-end: 64 }
214214
- { tp: 8, conc-start: 4, conc-end: 8 }
215215
- isl: 1024
216216
osl: 8192
217217
search-space:
218-
- { tp: 1, conc-start: 4, conc-end: 64 }
219-
- { tp: 2, conc-start: 4, conc-end: 64 }
218+
- { tp: 1, conc-start: 4, conc-end: 128 }
219+
- { tp: 2, conc-start: 4, conc-end: 128 }
220220
- { tp: 4, conc-start: 4, conc-end: 64 }
221221
- { tp: 8, conc-start: 4, conc-end: 8 }
222222
- isl: 8192
223223
osl: 1024
224224
search-space:
225-
- { tp: 1, conc-start: 4, conc-end: 64 }
226-
- { tp: 2, conc-start: 4, conc-end: 64 }
225+
- { tp: 1, conc-start: 4, conc-end: 128 }
226+
- { tp: 2, conc-start: 4, conc-end: 128 }
227227
- { tp: 4, conc-start: 4, conc-end: 64 }
228228
- { tp: 8, conc-start: 4, conc-end: 4 }
229229

0 commit comments

Comments
 (0)