pd with nixl backend (rebase main)#1002

Closed

kingder wants to merge 33 commits into

ModelTC:mainfrom

kingder:n_pd_nixl

Commits on Sep 2, 2025

WIP.
Weichao Luo
committed
working.
Weichao Luo
committed
prefill abort -> notify decode.
Weichao Luo
committed
fix long connect time.
Weichao Luo
committed
nixl pd.
Weichao Luo
committed
fixup.
Weichao Luo
committed
fixup.
Weichao Luo
committed
rename.
Weichao Luo
committed
fix lint.
Weichao Luo
committed
support dp for pd_nixl
Weichao Luo
committed
chunk transfer.
Weichao Luo
committed
fix max_new_token.
Weichao Luo
committed
rename args and update request state with list.
Weichao Luo
committed
update & add docker
Weichao Luo
committed
fix.
Weichao Luo
committed
fix lint.
Weichao Luo
committed
fix abort.
Weichao Luo
committed
fix prefill num_tokens > decode num_tokens

shihaobai
authored and
Weichao Luo
committed
fix chunked transfer & bugs.
Weichao Luo
committed
fix chunked transfer.
Weichao Luo
committed
paged transfer.
Weichao Luo
committed
rebase main.
Weichao Luo
committed
fix lint.
Weichao Luo
committed
fix.
Weichao Luo
committed
fixup.
Weichao Luo
committed
fixup.
Weichao Luo
committed
rebase main.
Weichao Luo
committed
fix first token bug.
Weichao Luo
committed
fix dp.
Weichao Luo
committed
fix lint.
Weichao Luo
committed
fixup.
Weichao Luo
committed
fixup.
Weichao Luo
committed
lint.
Weichao Luo
committed