-
Notifications
You must be signed in to change notification settings - Fork 29
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
[Feature] Model Selection by Actual Cost of Inference
kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#214 In llm-d/llm-d-inference-payload-processor;docs(plugins): add README.md documentation for all in-tree plugins
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#213 In llm-d/llm-d-inference-payload-processor;- Status: Open.#209 In llm-d/llm-d-inference-payload-processor;
- Status: Open.#208 In llm-d/llm-d-inference-payload-processor;
Discover available models by polling the router's /v1/models endpoint
kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#206 In llm-d/llm-d-inference-payload-processor;Add a TTFT percentile extractor for latency routing
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#205 In llm-d/llm-d-inference-payload-processor;- Status: Open.#194 In llm-d/llm-d-inference-payload-processor;
- Status: Open.#192 In llm-d/llm-d-inference-payload-processor;
- Status: Open.#190 In llm-d/llm-d-inference-payload-processor;
feat: Extend model name Filter
kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.Status: Open.#189 In llm-d/llm-d-inference-payload-processor;- Status: Open.#187 In llm-d/llm-d-inference-payload-processor;
[Feature]: Add a basic model name Filter
kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#171 In llm-d/llm-d-inference-payload-processor;