docs(proxy): add batch input-file pre-read controls

[Sameerlite]

Summary

• document disable_batch_input_file_rate_limiting in proxy config settings
• document provider/model skip-list settings for batch input-file pre-read
• add managed batches examples for global/provider/model and per-request controls

Test plan

• docs-only changes reviewed in preview/editor

Made with Cursor

---

Note

Low Risk
Documentation-only; no runtime or config parsing changes in this PR.

Overview
Documents how to skip pre-reading batch input files during POST /batches pre-checks (rate-limit/model validation), which matters for large inputs on custom deployments (e.g. hosted vLLM).

docs/proxy/config_settings.md adds three general_settings entries: global disable_batch_input_file_rate_limiting, plus provider and model/prefix allowlists skip_batch_input_file_rate_limiting_for_providers and skip_batch_input_file_rate_limiting_for_models, in both the sample YAML and the reference table.

docs/proxy/managed_batches.md extends the admin config.yaml example with those optional settings and shows per-request opt-out via metadata.skip_batch_input_file_rate_limiting on client.batches.create.

^{Reviewed by Cursor Bugbot for commit 34abc0d. Bugbot is set up for automated code reviews on this repo. Configure here.}

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
litellm	Ready	Preview, Comment	May 28, 2026 6:31am