Skip to content

feat: Tower based Middlewares#539

Merged
64bit merged 62 commits into
mainfrom
middleware
May 6, 2026
Merged

feat: Tower based Middlewares#539
64bit merged 62 commits into
mainfrom
middleware

Conversation

@64bit

@64bit 64bit commented May 6, 2026

Copy link
Copy Markdown
Owner
  • add support for middleware with Tower Service and Layer abstractions
  • add OpenAIRetryLayer which is specific for retrying OpenAI API, there's more generic retry policy SimpleRetryPolicy, both implements exponential backoff. This also removes the backoff crate dependency, and enables retries in WASM.
  • Add examples/{tower,middleware,tower-wasm}
  • Add new middlware docs in MIDDLEWARE.md doc and lib.rs
  • All is behind middleware feature flag

@64bit 64bit merged commit 2b3d8ad into main May 6, 2026
99 checks passed
@64bit 64bit deleted the middleware branch May 6, 2026 23:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant