issue/407 - Release the GIL; preallocated workspace#408

Closed

pengcheng888 wants to merge 6 commits into

mainfrom

Commits on Jun 10, 2026

issue/407 - preallocated workspace
wangpengcheng
committed
issue/407 - pybind: release GIL in forward() to avoid blocking other Python threads

ma-hang
authored and
wangpengcheng
committed
issue/407 - fix: early token budget check

ma-hang
authored and
wangpengcheng
committed
refactor with register_inference_buffer.
wangpengcheng
committed
refactor: improve WorkspaceManager buffer registration

ma-hang
authored and
wangpengcheng
committed
issue/407 - refine the code
wangpengcheng
committed