Commit 2914105
committed
transformerless_lm: v78 results -- self-reflection + A + B
Cycle 6 peak: 0.7096 (second-best ever, only v77 c2's 0.7204 is higher).
Mean: 0.6712 -- new mean record.
Cycle 6 sample reproduces THREE consecutive Richard II lines:
"by nature for herself" -> "built by Nature for herself"
"against hand and" -> "Against infection and the hand of war"
"happy this war, of men, little this men, little...world"
-> "this happy breed of men, this little world"
Cleanest Shakespeare reconstruction yet. The self-reflection
machinery (insight detection + momentum EMA + three-mode behavior
+ backtrack-on-collapse) produced the most coherent multi-line
Richard II output from 512 chars of training data.
Trajectory shape vs v77:
Peak softened (0.703 v78 vs 0.7204 v77 cycle 2)
Mid-cycles strengthened (3 and 4 both higher than v77)
Cycle 6 RECOVERED hard (0.7096 vs typical late-cycle drift)
A (sharpen/flatten on momentum) and B (backtrack-on-collapse via
newline boost) deliver: less peak luck, more consistent trajectory.1 parent e5fcb2b commit 2914105
1 file changed
Lines changed: 164 additions & 164 deletions
0 commit comments