Skip to content

Add DeltaLLM to AI Gateway section#392

Open
deltawi wants to merge 1 commit intoInftyAI:mainfrom
deltawi:add-deltallm-gateway
Open

Add DeltaLLM to AI Gateway section#392
deltawi wants to merge 1 commit intoInftyAI:mainfrom
deltawi:add-deltallm-gateway

Conversation

@deltawi
Copy link
Copy Markdown

@deltawi deltawi commented Apr 1, 2026

Add DeltaLLM

DeltaLLM is an open-source, self-hosted LLM gateway that provides:

  • OpenAI-compatible API for 100+ providers (OpenAI, Anthropic, Gemini, Groq, Azure, etc.)
  • Virtual keys with budget limits and rate limiting
  • Multi-provider routing, failover, and load balancing
  • Spend tracking and observability
  • Guardrails and content policies
  • Built-in MCP (Model Context Protocol) gateway with tool scoping

Deployed via Docker, MIT licensed, actively maintained.

I added it to the AI Gateway section in alphabetical order between APISIX and Envoy AI Gateway.

@InftyAI-Agent InftyAI-Agent added needs-triage Indicates an issue or PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Apr 1, 2026
@InftyAI-Agent InftyAI-Agent requested review from cr7258 and samzong April 1, 2026 18:23
@deltawi
Copy link
Copy Markdown
Author

deltawi commented Apr 6, 2026

Hi guys, if you have any questions on the product let me know.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do-not-merge/needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants