Skip to content

Commit 5cc4ba2

Browse files
User Nameclaude
andcommitted
397B entry: narrow the Q8/FP8 exclusion to Q8 + forward-link the FP8 redo
The new qwen3.6-27b-fp8 entry shows FP8 serving is stable (113/119 clean), so the 'Q8/FP8 both serving failures' framing was superseded. Narrow to Q8-serving-specific and point forward to the FP8 entry. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 45f35ea commit 5cc4ba2

1 file changed

Lines changed: 9 additions & 3 deletions

File tree

  • hardware-tests/qwen3.5-397b-vs-step3.7-flash-2026-05-29

hardware-tests/qwen3.5-397b-vs-step3.7-flash-2026-05-29/findings.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,9 +6,15 @@ the differences that matter are qualitative. Phase-1 cells graded with the **fix
66

77
**Cross-model note:** the 27B / Coder-Next reference columns are the **Q4/AWQ** runs from
88
`benchmarks/microbench-2026-04-28` (N=1, clean `done_signal`, older agent-pilot harness). We attempted
9-
fresh **Q8/FP8** runs of Qwen3.6-27B and Qwen3.6-35B-A3B on the current harness but **both were serving
10-
failures** (35B: 36/36 HTTP-400; 27B-Q8: 23/36 token-runaway + 8/36 HTTP-400, only 4 clean) — **excluded,
11-
not shown.** The Q4 artifacts are the trustworthy 27B/Coder comparison.
9+
fresh **Q8/FP8** runs of Qwen3.6-27B and Qwen3.6-35B-A3B on the current harness but the **first attempts
10+
were serving failures** (35B: 36/36 HTTP-400; 27B-Q8: 23/36 token-runaway + 8/36 HTTP-400, only 4 clean)
11+
**excluded, not shown** here. The Q4 artifacts are the trustworthy 27B/Coder comparison in *this* entry.
12+
13+
> **Update (2026-05-31):** a clean **FP8** redo of Qwen3.6-27B succeeded — 113/119 cells finished cleanly,
14+
> serving was stable, and it has its own full N=5 entry:
15+
> [`hardware-tests/qwen3.6-27b-fp8-microbench-2026-05-31/`](../qwen3.6-27b-fp8-microbench-2026-05-31/).
16+
> So the failure above was **Q8-serving-specific, not 27B-on-this-rig**; FP8 is a viable path. (The 35B-A3B
17+
> MoE failure is separate — the known Blackwell sm_120 MoE issue.)
1218
1319
## Setup
1420
- **Model:** Qwen3.5-397B-A17B, unsloth UD-Q3_K_XL GGUF (~167 GB on disk, 5 shards).

0 commit comments

Comments
 (0)