Skip to content

Latest commit

 

History

History
35 lines (30 loc) · 4.72 KB

File metadata and controls

35 lines (30 loc) · 4.72 KB

投机采样Benchmark

Eagle3

Qwen3 Series Models

MT-bench HumanEval GSM8K Alpaca Mean
Model Speedup τ Speedup τ Speedup τ Speedup τ Speedup τ
Qwen3-1.7B 2.05x 2.81 2.07x 2.93 2.11x 2.98 1.93x 2.69 2.04x 2.85
Qwen3-4B 2.21x 3.01 2.36x 3.24 2.42x 3.13 2.32x 2.75 2.33x 3.03
Temperature=0 Qwen3-8B 2.63x 3.65 2.76x 3.85 2.82x 3.90 2.62x 3.48 2.70x 3.72
Qwen3-14B 2.23x 3.30 2.53x 3.74 2.56x 3.79 2.16x 3.13 2.37x 3.49
Qwen3-32B 2.39x 2.78 2.37x 2.81 2.47x 2.92 2.42x 2.53 2.41x 2.76
Qwen3-30B-A3B 2.84x 3.63 2.27x 3.09 2.64x 3.42 2.83x 3.56 2.64x 3.42
Qwen3-1.7B 1.74x 2.53 1.86x 2.70 1.82x 2.69 1.93x 2.46 1.75x 2.60
Qwen3-4B 1.93x 2.60 2.00x 2.84 2.11x 2.82 2.34x 2.50 1.75x 2.69
Temperature=1 Qwen3-8B 1.98x 2.75 2.25x 3.11 2.31x 3.15 2.10x 2.76 2.90x 2.94
Qwen3-14B 1.71x 2.61 1.95x 2.87 2.04x 3.08 1.68x 2.55 2.90x 2.78
Qwen3-32B 1.62x 1.91 1.71x 2.05 1.78x 2.10 1.80x 1.95 1.62x 2.00
Qwen3-30B-A3B 1.91x 2.46 2.00x 2.64 1.90x 2.53 1.80x 2.32 1.90x 2.48

Hunyuan Series Models

MT-bench HumanEval GSM8K Alpaca Mean
Model Speedup τ Speedup τ Speedup τ Speedup τ Speedup τ
Hunyuan-1.8B 1.97x 2.90 2.58x 3.73 2.61x 3.71 1.71x 2.43 2.22x 3.19
Temperature=0 Hunyuan-4B 1.77x 2.60 2.64x 3.35 2.14x 3.17 1.72x 2.57 2.07x 2.92
Hunyuan-7B 2.22x 3.58 3.59x 5.47 2.96x 4.68 1.64x 2.56 2.60x 4.07
Hunyuan-1.8B 1.58x 2.36 2.35x 3.56 2.23x 3.38 1.26x 1.87 1.86x 2.79
Temperature=1 Hunyuan-1.8B 1.36x 2.05 1.97x 2.86 1.72x 2.68 1.14x 1.76 1.55x 2.34
Hunyuan-1.8B 1.90x 3.11 3.12x 5.09 2.74x 4.34 1.47x 2.39 2.31x 3.73