perf: optimize guided decoding with xgrammar upgrade, batched API, and async D2H overlap#4605
Open
windreamer wants to merge 6 commits into
Open
perf: optimize guided decoding with xgrammar upgrade, batched API, and async D2H overlap#4605windreamer wants to merge 6 commits into
windreamer wants to merge 6 commits into
Commits
Commits on Jun 9, 2026
- committed
- committed
- committed
- committed
- committed
- committed
