Skip to content

[Bugfix][Router] Seed the prefix trie on the below-threshold QPS fallback path#990

Open
vedcsolution wants to merge 2 commits into
vllm-project:mainfrom
vedcsolution:fix-prefixaware-min-match-seeding
Open

[Bugfix][Router] Seed the prefix trie on the below-threshold QPS fallback path#990
vedcsolution wants to merge 2 commits into
vllm-project:mainfrom
vedcsolution:fix-prefixaware-min-match-seeding

[Bugfix][Router] Do not insert None into the trie when no endpoints a…

b105ae8
Select commit
Loading
Failed to load commit list.