[Bugfix]: Fix streaming "connection closed" before body consumed in orchestrated disaggregated routing#960

ruizhang0101 merged 4 commits into

vllm-project:mainvllm-project/production-stack:mainfrom

shoreline2:issues/952shoreline2/production-stack:issues/952Copy head branch name to clipboard