Skip to content

Add Inference Labs under AI Gateway#443

Open
bosslesss wants to merge 1 commit into
InftyAI:mainfrom
bosslesss:add-inference-labs
Open

Add Inference Labs under AI Gateway#443
bosslesss wants to merge 1 commit into
InftyAI:mainfrom
bosslesss:add-inference-labs

Conversation

@bosslesss

Copy link
Copy Markdown

Hi! This adds Inference Labs under AI Gateway.

Why it fits:

  • Vendor-neutral multi-provider routing across OpenAI/Azure, Anthropic, Google, and Bedrock.
  • Policy controls for cost-first / quality-first / latency-first routing.
  • Semantic caching, failover, and trace-to-eval dataset export workflow.

Open-source Python SDK: https://github.com/bosslesss/inference-labs-python (Apache-2.0).

Happy to adjust wording or section placement if preferred.

@InftyAI-Agent InftyAI-Agent added needs-triage Indicates an issue or PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels May 30, 2026
@InftyAI-Agent InftyAI-Agent requested review from cr7258 and samzong May 30, 2026 01:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do-not-merge/needs-kind Indicates a PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants