Search results

feat: implement remote bidirectional dispatch in PushRouter (3/N)

dynamo-llmRelates to dynamo-llm componentRelates to dynamo-llm component

enhancementNew feature or requestNew feature or request

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

Status: Open.

#9361 In ai-dynamo/dynamo;

· GuanLuo opened on May 9, 2026

SGLang unified backend: prefill worker has no drain() — NIXL KV transfer can be torn down mid-flight

backend::sglangRelates to the sglang backendRelates to the sglang backend

bugSomething isn't workingSomething isn't working

nixlRelates to NIXLRelates to NIXL

Status: Open.

#9345 In ai-dynamo/dynamo;

· tanmayv25 opened on May 8, 2026

vLLM unified backend: prefill worker has no drain() — NIXL KV transfer can be torn down mid-flight

backend::vllmRelates to the vllm backendRelates to the vllm backend

bugSomething isn't workingSomething isn't working

fault tolerance

language::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python code

nixlRelates to NIXLRelates to NIXL

Status: Open.

#9344 In ai-dynamo/dynamo;

· tanmayv25 opened on May 8, 2026

vLLM unified backend: python process hangs after Worker.run() returns on SIGTERM

backend::vllmRelates to the vllm backendRelates to the vllm backend

bugSomething isn't workingSomething isn't working

fault tolerance

language::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python code

nixlRelates to NIXLRelates to NIXL

Status: Open.

#9343 In ai-dynamo/dynamo;

· tanmayv25 opened on May 8, 2026

Help tuning Dynamo + SGLang aggregate and P/D performance on H200 multi-node workloads

backend::sglangRelates to the sglang backendRelates to the sglang backend

deployment::natsRelated to nats.io / nats-server / jetstreamRelated to nats.io / nats-server / jetstream

discovery

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

performanceInvolves the performance of DynamoInvolves the performance of Dynamo

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#9328 In ai-dynamo/dynamo;

· mvillmow opened on May 8, 2026

DEP: FileStore CAS and discovery coordination leases

dep:draftDEP in draft statusDEP in draft status

discovery

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

enhancementNew feature or requestNew feature or request

fault tolerance

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#9325 In ai-dynamo/dynamo;

· PeaBrane opened on May 8, 2026

[FEATURE]: Standardize decode worker component name across framework adapters

Feature

Status: Open.

#9319 In ai-dynamo/dynamo;

· stevie-35 opened on May 8, 2026

DEP: kvbm-v2 xpu-sycl enablement

dep:draftDEP in draft statusDEP in draft status

enhancementNew feature or requestNew feature or request

kvbm

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

Status: Open.

#9313 In ai-dynamo/dynamo;

· zxue2 opened on May 8, 2026

[BUG]: Failed to load CuPy for GPU acceleration due to CUDA version mismatch

backend::vllmRelates to the vllm backendRelates to the vllm backend

bugSomething isn't workingSomething isn't working

Dynamo 1.1.0

Status: Open.

#9312 In ai-dynamo/dynamo;

· kreeuwijk opened on May 8, 2026

[CONTRIBUTION]: Hybrid Worker: Utilize Idle Prefill GPU Capacity for Overflow Decode in Disaggregated Serving

backend::vllmRelates to the vllm backendRelates to the vllm backend

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

dynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime component

enhancementNew feature or requestNew feature or request

language::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust code

performanceInvolves the performance of DynamoInvolves the performance of Dynamo

pythonPull requests that update python codePull requests that update python code

routerRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.

Status: Open.

#9311 In ai-dynamo/dynamo;

· mcpark84 opened on May 8, 2026

[CONTRIBUTION]: Enable encoder_only mode for SGLang multimodal encode workers

backend::sglangRelates to the sglang backendRelates to the sglang backend

bugSomething isn't workingSomething isn't working

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

language::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python code

Status: Open.

#9291 In ai-dynamo/dynamo;

· dsocek opened on May 7, 2026

[CONTRIBUTION]: [FEATURE]: Enforce user-config preservation in TRT-LLM worker arg_map

backend::trtllmRelates to the trtllm backendRelates to the trtllm backend

contribution-requestExternal contributor proposing to implement a changeExternal contributor proposing to implement a change

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

observabilityRelated to metrics, tracing, loggingRelated to metrics, tracing, logging

Status: Open.

#9288 In ai-dynamo/dynamo;

· indrajit96 opened on May 7, 2026