EmbeddedLLM
We are committed to making production-grade AI inference as accessible and reliable as electricity, powered by vLLM.
Pinned Loading
Repositories
Showing 10 of 79 repositories
- litellm Public Forked from BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
- agentic-api Public Forked from vllm-project/agentic-api
Stateful API logic for agentic applications using vLLM
- tokenvisor-pi Public
- vllm Public Forked from vllm-project/vllm
vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
- TokenVisor-charts Public
- vllm-rocm-wheel Public
- JamAIBase Public
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.
- fastsafetensors Public Forked from foundation-model-stack/fastsafetensors
High-performance safetensors model loader
Top languages
Loading…
Most used topics
Loading…