Skip to content

Commit c9dac34

Browse files
authored
Cache graph traversal and routing for inference (#281)
Precompute DAG traversal, in/out degrees, and per-layer edge routing after graph mutations instead of rebuilding them on every inference. Replace hash-based branch tracking with dense layer-id indexed state and cached input bindings, preserving the existing tensor flow while removing repeated topology scans from the execution path.
1 parent 6f356bf commit c9dac34

2 files changed

Lines changed: 221 additions & 135 deletions

File tree

0 commit comments

Comments
 (0)