Skip to content

feat: PD disaggregation for vLLM and SGLang#1217

Merged
Rader merged 3 commits into
mainfrom
sync_mr_2643_1a9dea9
Jul 1, 2026
Merged

feat: PD disaggregation for vLLM and SGLang#1217
Rader merged 3 commits into
mainfrom
sync_mr_2643_1a9dea9

Conversation

@csg-pr-bot

@csg-pr-bot csg-pr-bot commented Jun 29, 2026

Copy link
Copy Markdown
Collaborator

Summary:

  • Adds PD (Prefill-Decode) disaggregation support for vLLM and SGLang, enabling separate scheduling and auto-scaling of prefill/decode roles via Knative, LWS, EPP, and InferencePool.
  • Introduces new type definitions, resource orchestration logic, and hardware-aware parallelism planners to automatically generate and manage disaggregated K8s resources.
  • Extends the CS-GraphHub deployment pipeline with a pdConfig field and provides dedicated startup scripts that align with official engine parameters for seamless integration.

@csg-pr-bot

csg-pr-bot commented Jun 29, 2026

Copy link
Copy Markdown
Collaborator Author

Depends on #1216

@csg-pr-bot csg-pr-bot mentioned this pull request Jun 29, 2026
Merged
CementZhang
CementZhang previously approved these changes Jul 1, 2026
View reviewed changes

@CementZhang CementZhang left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@Rader Rader merged commit c465f2d into main Jul 1, 2026
7 checks passed
@Rader Rader deleted the sync_mr_2643_1a9dea9 branch July 1, 2026 07:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Rader Rader Rader approved these changes
@CementZhang CementZhang CementZhang approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@csg-pr-bot @Rader @CementZhang