Skip to content

Project Request: AI Model Gateway #440

Description

@SSC-STUDIO

Project Information - Project name: AI Model Gateway - Github URL: https://github.com/SSC-STUDIO/Ai-Model-Gateway - Homepage URL: https://ssc-studio.github.io/Ai-Model-Gateway/ - Logo URL: https://raw.githubusercontent.com/SSC-STUDIO/Ai-Model-Gateway/main/docs/assets/social-card.png ## Category - Inference - [ ] Inference Engine - [ ] Inference Platform - [ ] Middleware - [x] LLM Router - [ ] AI Gateway - [ ] Output - [ ] Simulator - [ ] Benchmark - Orchestration - [ ] Application Framework - [ ] Agent Framework - [ ] Evolutionary Framework - [ ] RAG - [ ] Workflow - Runtime - [ ] AI Terminal - [ ] AI Agent - [ ] Chatbot - [ ] Code Agent - [ ] Database - [ ] Evolve Agent - [ ] Observation - [ ] Sandbox - [ ] Tool - Training - [ ] Framework - [ ] FineTune - [ ] RLHF - [ ] Agentic RL - [ ] Benchmark - [ ] Workflow ## Notes AI Model Gateway is a self-hosted LLM operations gateway focused on OpenAI-compatible routing, provider fallback, rate limiting, telemetry, benchmarking, config publishing, diagnostics, updates, and rollback. Useful project links: - 15-minute evaluation path: https://github.com/SSC-STUDIO/Ai-Model-Gateway/blob/main/docs/evaluate-in-15-minutes.md - Provider fallback demo: https://github.com/SSC-STUDIO/Ai-Model-Gateway/tree/main/examples/provider-fallback - Documentation index: https://github.com/SSC-STUDIO/Ai-Model-Gateway/tree/main/docs

Reviewer evidence

Adoption checklist evidence

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-priorityIndicates a PR lacks a label and requires one.needs-triageIndicates an issue or PR lacks a label and requires one.

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions