Commit 99ff61f
committed
### Added
- Added compact direct-input fast path for non-vocab float tensors where the trailing feature dimension matches `len(input_ids)`, avoiding dense neuron-space expansion.
- Added regression tests for compact input paths and single-step output scaling consistency.
### Changed
- Optimized recurrent forward internals in `OdyssNet`:
- lazy input-scale lookup in sparse legacy injection,
- precomputed Hebbian row/diagonal factors,
- correlation matrix computation switched from `einsum` to `matmul`,
- skipped unnecessary Hebbian buffer clones in no-grad inference,
- selective scaling applied only to output neurons.
- Optimized `OdyssNetTrainer` data movement and AMP plumbing by caching device-type flags, using non-blocking tensor transfers, and reusing compact direct-input routing in both `train_batch()` and `predict()`.
- Optimized `examples/advanced/experiment_financial_oracle.py` with vectorized split sampling, vectorized BTC overlay window normalization, pinned-memory GPU transfer path, reusable best-state snapshots, and downsampled workbench heatmap rendering.
### Fixed
- Fixed single-step output scaling aliasing where scaled outputs could share storage with returned final state.
- Fixed trainer single-step extraction to consistently use scaled last-timestep outputs.1 parent fe07106 commit 99ff61f
10 files changed
Lines changed: 463 additions & 105 deletions
File tree
- docs
- examples/advanced
- odyssnet
- core
- training
- tests
- core
- training
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
7 | 27 | | |
8 | 28 | | |
9 | 29 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
| 8 | + | |
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
159 | 159 | | |
160 | 160 | | |
161 | 161 | | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
162 | 174 | | |
163 | 175 | | |
164 | 176 | | |
| |||
0 commit comments