Blog post: Agentgateway and vLLM Semantic Router Integration 101 - #779
Open
DuncanDoyle wants to merge 6 commits into
Open
Blog post: Agentgateway and vLLM Semantic Router Integration 101#779DuncanDoyle wants to merge 6 commits into
DuncanDoyle wants to merge 6 commits into
Conversation
…on of the Agentgateway documentation.
danehans
reviewed
Jul 23, 2026
| title: "Semantic Routing, Assembled: agentgateway and vLLM Semantic Router in Practice" | ||
| category: "Deep Dive" | ||
| toc: false | ||
| publishDate: 2026-07-28 |
Collaborator
There was a problem hiding this comment.
Let's be mindful of the date this gets merged sopublishDate is correct.
Author
There was a problem hiding this comment.
If we merge (and publish) on Tuesday (so the 28th), that works for me.
danehans
reviewed
Jul 23, 2026
danehans
reviewed
Jul 23, 2026
danehans
reviewed
Jul 23, 2026
danehans
reviewed
Jul 23, 2026
danehans
reviewed
Jul 23, 2026
danehans
reviewed
Jul 23, 2026
danehans
reviewed
Jul 23, 2026
Comment on lines
+73
to
+79
| - { group: gateway.networking.k8s.io, kind: Gateway, name: agentgateway-proxy, namespace: agentgateway-system } | ||
| rules: | ||
| - matches: | ||
| - path: { type: PathPrefix, value: /v1/chat/completions } | ||
| - path: { type: PathPrefix, value: /v1/responses } | ||
| backendRefs: | ||
| - { group: agentgateway.dev, kind: AgentgatewayBackend, name: openai-router-selected, namespace: agentgateway-system } |
Collaborator
There was a problem hiding this comment.
Consider updating the formatting to be the same as https://github.com/agentgateway/agentgateway/blob/main/examples/llm-semantic-routing/k8s/agentgateway-routing.yaml
danehans
reviewed
Jul 23, 2026
danehans
reviewed
Jul 23, 2026
|
|
||
| ### Configuring vSR: signals → score → decision | ||
|
|
||
| vSR's behaviour lives in its Helm values (`semantic-router-values.yaml`). It reads like a small rules engine, and it's worth understanding as a pipeline, because vSR traces its own work with a span per stage (`semantic_router.signal.*` for signal evaluation, `semantic_router.decision.evaluation` for the decision, and `semantic_router.plugin.execution` for the plugin chain). A trace reads back as that same pipeline. |
Collaborator
There was a problem hiding this comment.
danehans
reviewed
Jul 23, 2026
Collaborator
|
Overall looks great! I provided some feedback to consider. Otherwise, /lgtm. |
Author
|
@danehans Addressed all your comments and pushed the changes. Good to merge on Tuesday (current publish date set in the md). |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
As a follow up to Daneyon's blog post on cost reduction with Agentgateway and vLLM Semantic Router (https://agentgateway.dev/blog/2026-07-17-semantic-routing-llm-costs/) I wrote a follow up post that explains how these 2 platforms integrate and how users can get started themselves.