Skip to content

v0.3.0 — LiteLLM backend for non-OpenAI providers

Latest

Choose a tag to compare

@he-yufeng he-yufeng released this 04 May 15:27
· 5 commits to main since this release

What's new

LiteLLM backend for non-OpenAI providers (#10, contributed by @RheagalFire)

Set CORECODER_PROVIDER=litellm and use any LiteLLM model string —
anthropic/claude-3-haiku, bedrock/anthropic.claude-v2, vertex_ai/gemini-pro, etc.

pip install 'corecoder[litellm]'
export CORECODER_PROVIDER=litellm
export CORECODER_MODEL=anthropic/claude-3-haiku
export ANTHROPIC_API_KEY=sk-ant-...
corecoder

Routes through to 100+ providers (Bedrock, Vertex AI, Cohere, Groq, Replicate, Anyscale, …) via one model-string convention.

Compatibility

The default openai backend is unchanged. Existing setups using OpenAI-compatible endpoints (Kimi, DeepSeek, Qwen, Ollama, …) keep working with no migration.

Install

pip install corecoder            # default
pip install 'corecoder[litellm]' # with LiteLLM