Commit 67ee407
committed
test(v5-g14): tighten V4-4 convergence floor — N=16 + no-blow-up bounds
Closes V5-G14 / cppmega-mlx-amy. V4-4 was pure-OR (last<first OR
tailAvg<headAvg), satisfied by single-step random drift. Stricter
now: N=16 steps, AND a no-blow-up + no-collapse cap on the second
half losses.
Spec proposal §G14 asked for 5% reduction floor; that turned out to
be unrealistic for the synthetic 2-brick model + real corpus + AdamW
lr=3e-4 — the model is too tiny to fit real tokens at that LR; loss
oscillates within ±30% of initial. What v5 requires:
- extras.num_steps === 16 (was 8 in V4-4)
- extras.losses.length === 16
- max(second_half) < losses[0] * 1.5 (no divergence — V4-4 lacked
any upper bound; any monotone-down single step passed)
- min(second_half) > losses[0] * 0.3 (no collapse to zero on tiny
model, would indicate NaN spike or shortcut)
Strict V3-6 5% convergence assertion already exists for the synthetic-
data path on the SAME presets, so v5 cap-only assertion here doesn't
weaken overall coverage — it adds a bounded-behaviour gate that V4-4
was missing while staying realistic for tiny-model real-data noise.
2/2 e2e green on llama3_8b + mistral_small_3_1.1 parent 0be1916 commit 67ee407
1 file changed
Lines changed: 19 additions & 17 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
44 | | - | |
| 44 | + | |
| 45 | + | |
45 | 46 | | |
46 | 47 | | |
47 | | - | |
| 48 | + | |
48 | 49 | | |
49 | 50 | | |
50 | | - | |
| 51 | + | |
51 | 52 | | |
52 | 53 | | |
53 | 54 | | |
| |||
61 | 62 | | |
62 | 63 | | |
63 | 64 | | |
64 | | - | |
65 | | - | |
66 | | - | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
67 | 68 | | |
68 | 69 | | |
69 | | - | |
70 | | - | |
71 | | - | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
72 | 77 | | |
73 | | - | |
74 | | - | |
75 | | - | |
76 | | - | |
77 | | - | |
78 | | - | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
79 | 81 | | |
80 | | - | |
81 | | - | |
| 82 | + | |
| 83 | + | |
82 | 84 | | |
83 | 85 | | |
84 | 86 | | |
| |||
0 commit comments