Commit c9dac34
authored
Cache graph traversal and routing for inference (#281)
Precompute DAG traversal, in/out degrees, and per-layer edge routing
after graph mutations instead of rebuilding them on every inference.
Replace hash-based branch tracking with dense layer-id indexed state and
cached input bindings, preserving the existing tensor flow while
removing repeated topology scans from the execution path.1 parent 6f356bf commit c9dac34
2 files changed
Lines changed: 221 additions & 135 deletions
0 commit comments