Skip to content

add litellm error to the default retry exceptions #291

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mayinghan merged 4 commits into from
Oct 25, 2025
Merged

add litellm error to the default retry exceptions #291

Changes from 2 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
77265af
add litellm error to the default retry exceptions
mayinghan Oct 25, 2025
1de86db
format
mayinghan Oct 25, 2025
88a9f88
add
mayinghan Oct 25, 2025
b37ff01
format
mayinghan Oct 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 7 additions & 1 deletion eval_protocol/pytest/exception_config.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@

import backoff


import litellm
import requests
import httpx

Expand All @@ -28,6 +28,12 @@
httpx.TimeoutException,
httpx.NetworkError,
httpx.RemoteProtocolError,
litellm.exceptions.RateLimitError,
litellm.exceptions.InternalServerError,
litellm.exceptions.Timeout,
litellm.exceptions.NotFoundError,
litellm.exceptions.BadRequestError,

@cursor cursor Bot Oct 25, 2025

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bug: Retryable Exceptions Include Permanent Errors

Including litellm.exceptions.NotFoundError and litellm.exceptions.BadRequestError in the default retryable exceptions is problematic. These typically represent permanent client-side errors (like HTTP 400/404) that won't resolve on retry, leading to wasteful attempts and delayed failure reporting.

Fix in Cursor Fix in Web

litellm.exceptions.ServiceUnavailableError,
}


Expand Down
Loading