Skip to content

Commit 85606a7

Browse files
authored
Create minimaxm3_eagle3_gqa.yaml with AL values (#2413)
Add acceptance length reference values for minimax-m3 model.
1 parent 4e8bd8e commit 85606a7

1 file changed

Lines changed: 28 additions & 0 deletions

File tree

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,28 @@
1+
# Source GitHub Actions run: https://github.com/SemiAnalysisAI/InferenceX/actions/runs/29784780049
2+
# Acceptance Length (AL) reference values measured with SPEED-Bench.
3+
# dataset: coding | temperature: 1.0 | top_p: 0.95 | top_k: 40 | output_len: 4096
4+
# thinking_on chat_template_kwargs: {"thinking_mode": "enabled"}
5+
# thinking_off chat_template_kwargs: {"thinking_mode": "disabled"}
6+
# Measured on minimax-m3 (B300, vLLM EAGLE3), per num_speculative_tokens.
7+
# Auto-generated by benchmarks/single_node/speedbench/minimaxm3_fp4_b300_vllm.sh (speedbench-al.yml).
8+
#
9+
# key = num_speculative_tokens (EAGLE3 level); value = golden AL
10+
minimax-m3:
11+
thinking_on:
12+
1: 1.79
13+
2: 2.39
14+
3: 2.78
15+
4: 3.02
16+
5: 3.21
17+
6: 3.30
18+
7: 3.52
19+
8: 3.51
20+
thinking_off:
21+
1: 1.83
22+
2: 2.46
23+
3: 2.97
24+
4: 3.29
25+
5: 3.72
26+
6: 3.76
27+
7: 3.75
28+
8: 3.93

0 commit comments

Comments
 (0)