Skip to content

Commit bddd3d9

Browse files
authored
Add placeholder MiniMax and GLM vLLM benchmarks (#6068)
* feat: add MiniMax-M2.7 and GLM-5.1 model benchmarks Validated on p6-b300.48xlarge (8x B300, 2.1TB VRAM): - minimax-m2.7: TP=4, FP8, 1900 output tok/s → min 950 - glm-5.1: TP=8, bf16, 674 output tok/s → min 330 Fleet 'x86-p6b300-runner' needs to be created in CDK infra. * chore: comment out MiniMax/GLM entries pending fleet creation * chore: rename placeholder fleet to x86-p5e-runner
1 parent 29a60b3 commit bddd3d9

1 file changed

Lines changed: 23 additions & 0 deletions

File tree

.github/config/model-tests/vllm-model-tests.yml

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -104,6 +104,29 @@ benchmark:
104104
min_throughput: 680
105105
min_rps: 5.3
106106

107+
# Pending p5e.48xlarge fleet creation. Fleet name "x86-p5e-runner" is a placeholder.
108+
# - name: "minimax-m2.7"
109+
# s3_model: "minimax-m2.7.tar.gz"
110+
# fleet: "x86-p5e-runner"
111+
# extra_args: "--tensor-parallel-size 4 --max-model-len 4096 --dtype auto --trust-remote-code"
112+
# input_len: 512
113+
# output_len: 128
114+
# num_prompts: 64
115+
# batch_size: 4
116+
# min_throughput: 950
117+
# min_rps: 7.4
118+
119+
# - name: "glm-5.1"
120+
# s3_model: "glm-5.1.tar.gz"
121+
# fleet: "x86-p5e-runner"
122+
# extra_args: "--tensor-parallel-size 8 --max-model-len 4096 --dtype auto --trust-remote-code"
123+
# input_len: 512
124+
# output_len: 128
125+
# num_prompts: 64
126+
# batch_size: 4
127+
# min_throughput: 330
128+
# min_rps: 2.6
129+
107130
- name: "qwen3.5-9b"
108131
s3_model: "qwen3.5-9b.tar.gz"
109132
fleet: "x86-g6xl-runner"

0 commit comments

Comments
 (0)