Commit eaa8682
committed
transformerless_lm: omniweight fluid form (tanh-backed standard)
Replace hard clamp [-pi*log(phi), +pi*log(phi)] with fluid form:
fluid_delta = phi^pi * tanh(delta_acc / phi^pi)
phi^pi ~ 4.53 is the substrate reserve standard (same constant as
bigram blend alpha, recency, harmony scale). Small contributions
pass nearly linear (tanh near origin ~ identity). Large contributions
saturate gracefully toward +/- phi^pi.
Key property: when primitives agree, sum grows naturally inside
the linear region. When they disagree, contributions cancel within
the sum -- no artificial ceiling restricting growth.
User-named architecture (omniweight, ported from earlier robotics
control work). Backed-standard not clamp.1 parent 91c484f commit eaa8682
1 file changed
Lines changed: 20 additions & 7 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1292 | 1292 | | |
1293 | 1293 | | |
1294 | 1294 | | |
1295 | | - | |
1296 | | - | |
1297 | | - | |
| 1295 | + | |
| 1296 | + | |
| 1297 | + | |
| 1298 | + | |
| 1299 | + | |
| 1300 | + | |
| 1301 | + | |
| 1302 | + | |
1298 | 1303 | | |
1299 | 1304 | | |
1300 | 1305 | | |
| |||
1310 | 1315 | | |
1311 | 1316 | | |
1312 | 1317 | | |
1313 | | - | |
1314 | | - | |
| 1318 | + | |
| 1319 | + | |
| 1320 | + | |
| 1321 | + | |
| 1322 | + | |
| 1323 | + | |
| 1324 | + | |
| 1325 | + | |
| 1326 | + | |
| 1327 | + | |
1315 | 1328 | | |
1316 | | - | |
1317 | | - | |
| 1329 | + | |
| 1330 | + | |
1318 | 1331 | | |
1319 | 1332 | | |
1320 | 1333 | | |
| |||
0 commit comments