Skip to content

[Bugfix][Router] Fix router auth for transcription proxy#914

Merged
ruizhang0101 merged 2 commits into
vllm-project:mainfrom
yzhan1:codex/fix-router-transcription-auth
Apr 23, 2026
Merged

[Bugfix][Router] Fix router auth for transcription proxy#914
ruizhang0101 merged 2 commits into
vllm-project:mainfrom
yzhan1:codex/fix-router-transcription-auth

Conversation

@yzhan1

@yzhan1 yzhan1 commented Apr 12, 2026

Copy link
Copy Markdown
Contributor

Summary

  • preserve client auth headers when proxying rebuilt multipart transcription requests instead of dropping them
  • skip the stale incoming multipart Content-Type so aiohttp can generate the correct boundary for the rebuilt form body
  • normalize X-Request-Id on forwarded requests and add regression tests for both the JSON and multipart proxy paths

Testing

  • uv run --group test python -m pytest -q src/tests/test_request_auth_headers.py src/tests/test_audio_speech_routing.py
  • uv run --group test python -m pytest -q src/tests

Closes #910.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a centralized _build_backend_request_headers function to handle header sanitization and authentication for backend requests, supported by new unit tests. Feedback points out that the current implementation may result in duplicate headers if Authorization or X-Request-Id are already present in the source request, and suggests lowering the log level for authentication messages to DEBUG to reduce log noise.

Comment thread src/vllm_router/services/request_service/request.py
@yzhan1 yzhan1 force-pushed the codex/fix-router-transcription-auth branch 4 times, most recently from 48294e6 to 38bea49 Compare April 12, 2026 19:07
@yzhan1 yzhan1 changed the title Fix router auth for transcription proxy [Bugfix][Router] Fix router auth for transcription proxy Apr 12, 2026
@yzhan1 yzhan1 marked this pull request as ready for review April 12, 2026 21:00
@ruizhang0101

Copy link
Copy Markdown
Collaborator

Hi, I think this PR is good to go after resolving the conflict.

Signed-off-by: Yaoming Zhan <yzhan@Mac.attlocal.net>
@yzhan1 yzhan1 force-pushed the codex/fix-router-transcription-auth branch from 14b27c9 to 6611164 Compare April 21, 2026 03:37
@yzhan1

yzhan1 commented Apr 21, 2026

Copy link
Copy Markdown
Contributor Author

@ruizhang0101 thanks! Fixed the conflict

@ruizhang0101 ruizhang0101 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ruizhang0101 ruizhang0101 merged commit 7a9ed88 into vllm-project:main Apr 23, 2026
27 of 35 checks passed
ikaadil pushed a commit to ikaadil/production-stack that referenced this pull request May 2, 2026
Signed-off-by: Yaoming Zhan <yzhan@Mac.attlocal.net>
Co-authored-by: Yaoming Zhan <yzhan@Mac.attlocal.net>
Co-authored-by: Rui Zhang <51696593+ruizhang0101@users.noreply.github.com>
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bug: Router does not authenticate with vllmApiKey to /v1/audio/transcriptions in v0.1.10

2 participants