feat(error-passthrough): support local account selection errors#3340
Open
techotaku39 wants to merge 1 commit into
Open
feat(error-passthrough): support local account selection errors#3340techotaku39 wants to merge 1 commit into
techotaku39 wants to merge 1 commit into
Conversation
Contributor
|
Thank you for your contribution! Before we can merge this PR, we need you to sign our Contributor License Agreement (CLA). To sign, please reply with the following comment:
You only need to sign once — it will be valid for all your future contributions to this project. I have read the CLA Document and I hereby sign the CLA You can retrigger this bot by commenting recheck in this Pull Request. Posted by the CLA Assistant Lite bot. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR extends error passthrough rules to local account-selection failures, especially
no available accountserrors that happen before an upstream request is made.Previously, local routing failures returned hardcoded messages such as
Service temporarily unavailableorNo available accounts, so administrators could not customize these client-facing responses through error passthrough rules.With this change, administrators can create an error passthrough rule for local account-selection failures, customize the response status code, and render a user-friendly message with best-effort account reset details.
Changes
/messages/chat/completions/responses/responses/messages/chat/completions/embeddingsUsage example
Administrators can create a rule like:
503no available accountsall429账户额度已用完,最快重置时间:{{next_reset_at}},账号:{{next_reset_account}}。详情:{{account_summary}}Supported template variables:
{{next_reset_at}}{{next_reset_account}}{{account_summary}}The account summary is best-effort and only includes non-secret metadata such as account name, platform, scheduling status, quota state, rate-limit reset time, overload time, temporary unschedulable reason, and Codex/OpenAI quota snapshots when available.
Testing
go test -tags=unit ./...go test -tags=integration ./...golangci-lint run --timeout=30mpnpm run lint:checkpnpm run typecheckNotes
No database schema changes are required.
No Ent code generation is required.
No frontend dependency changes are required.