-
Notifications
You must be signed in to change notification settings - Fork 1.3k
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
[FEATURE]: Model vLLM hybrid KV cache groups in mocker replays
backend::vllmRelates to the vllm backendRelates to the vllm backenddynamo-llmRelates to dynamo-llm componentRelates to dynamo-llm componentenhancementNew feature or requestNew feature or requestStatus: Open.#11726 In ai-dynamo/dynamo;[BUG]: Compliance check fails for vLLM CPU images
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingStatus: Open.#11706 In ai-dynamo/dynamo;[BUG]: vLLM chat-processor silently drops request body chat_template_kwargs
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingfrontend`python -m dynamo.frontend` and `dynamo-run in=http|text|grpc``python -m dynamo.frontend` and `dynamo-run in=http|text|grpc`language::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python codeStatus: Open.#11704 In ai-dynamo/dynamo;[BUG]: vLLM chat-processor ignores --default-chat-template-kwargs
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingfrontend`python -m dynamo.frontend` and `dynamo-run in=http|text|grpc``python -m dynamo.frontend` and `dynamo-run in=http|text|grpc`language::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python codeStatus: Open.#11703 In ai-dynamo/dynamo;DEP: KV Cache Controller
dep:draftDEP in draft statusDEP in draft statusenhancementNew feature or requestNew feature or requestrouterRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.Status: Open.DEP: EPP Embedded SelectionService Interface
backend::sglangRelates to the sglang backendRelates to the sglang backendbackend::trtllmRelates to the trtllm backendRelates to the trtllm backendbackend::vllmRelates to the vllm backendRelates to the vllm backenddep:draftDEP in draft statusDEP in draft statusdeployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetesenhancementNew feature or requestNew feature or requestrouterRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.Status: Open.#11661 In ai-dynamo/dynamo;[DOCS]: Fix incorrect default maximum for request duration histogram
bugSomething isn't workingSomething isn't workingdocumentationImprovements or additions to documentationImprovements or additions to documentationlanguage::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust codeobservabilityRelated to metrics, tracing, loggingRelated to metrics, tracing, loggingStatus: Open.#11657 In ai-dynamo/dynamo;[BUG]: Frontend reports model not found with local --model-path and HF-style --model-name
backend::vllmRelates to the vllm backendRelates to the vllm backendbugSomething isn't workingSomething isn't workingdeployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetesfrontend`python -m dynamo.frontend` and `dynamo-run in=http|text|grpc``python -m dynamo.frontend` and `dynamo-run in=http|text|grpc`language::pythonIssues/PRs that reference Python codeIssues/PRs that reference Python codeStatus: Open.#11650 In ai-dynamo/dynamo;DEP: extract dynamo-runtime-protocols leaf crate so lean consumers avoid the distributed runtime
dep:draftDEP in draft statusDEP in draft statusdependenciesRelates to dependencies of DynamoRelates to dependencies of Dynamodynamo-llmRelates to dynamo-llm componentRelates to dynamo-llm componentdynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime componentenhancementNew feature or requestNew feature or requestlanguage::rustIssues/PRs that reference Rust codeIssues/PRs that reference Rust coderouterRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.Status: Open.#11649 In ai-dynamo/dynamo;DEP: Rewrite Dynamo custom resources to v1beta1 storage
dep:draftDEP in draft statusDEP in draft statusdeployment::k8sRelates to dynamo deployment in kubernetesRelates to dynamo deployment in kubernetesenhancementNew feature or requestNew feature or requestStatus: Open.#11642 In ai-dynamo/dynamo;vLLM MVP: persistent GMS KV failover with exact block recovery
backend::vllmRelates to the vllm backendRelates to the vllm backenddynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime componentStatus: Open.#11600 In ai-dynamo/dynamo;DEP: Phase-specific routing policies for disaggregated prefill and decode
backend::vllmRelates to the vllm backendRelates to the vllm backenddep:draftDEP in draft statusDEP in draft statusdynamo-llmRelates to dynamo-llm componentRelates to dynamo-llm componentdynamo-runtimeRelates to the dynamo-runtime componentRelates to the dynamo-runtime componentenhancementNew feature or requestNew feature or requestrouterRelates to routing, KV-aware routing, etc.Relates to routing, KV-aware routing, etc.Status: Open.#11586 In ai-dynamo/dynamo;