|
1 | 1 | +++ |
2 | 2 | title = "LocalAI" |
3 | | -description = "The free, OpenAI and Anthropic alternative. A small, composable AI stack: run any model locally and install only what you use." |
| 3 | +description = "The open, modular AI runtime. Run text, vision, voice, image, video, agents, and more on hardware you control." |
4 | 4 | type = "home" |
5 | 5 | +++ |
6 | 6 |
|
7 | | -**The free, OpenAI and Anthropic alternative. A small, composable AI stack.** - Run powerful language models, autonomous agents, and document intelligence **locally** on your hardware. A lean core that pulls model backends on demand, so you install only what you use. |
8 | | - |
9 | | -**No cloud, no limits, no compromise.** |
10 | | - |
11 | | -{{% notice tip %}} |
12 | | -**[⭐ Star us on GitHub](https://github.com/mudler/LocalAI)** - 40k+ stars and growing! |
13 | | - |
14 | | -**Drop-in replacement for OpenAI API** - modular suite of tools that work seamlessly together or independently. |
15 | | - |
16 | | -Start with **[LocalAI](https://localai.io)**'s OpenAI-compatible API, extend with **[LocalAGI](https://github.com/mudler/LocalAGI)**'s autonomous agents, and enhance with **[LocalRecall](https://github.com/mudler/LocalRecall)**'s semantic search - all running locally on your hardware. |
17 | | - |
18 | | -**Open Source** MIT Licensed. |
19 | | -{{% /notice %}} |
20 | | - |
21 | | -<center><iframe width="560" height="315" src="https://www.youtube.com/embed/PDqYhB9nNHA?si=jUClTH7uuGMwMvFw" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe></center> |
22 | | - |
23 | | -## Why Choose LocalAI? |
24 | | - |
25 | | -**OpenAI API Compatible** - Run AI models locally with our modular ecosystem. From language models to autonomous agents and semantic search, build your complete AI stack without the cloud. |
26 | | - |
27 | | -### Key Features |
28 | | - |
29 | | -- **LLM Inferencing**: LocalAI is a free, **Open Source** OpenAI alternative. Run **LLMs**, generate **images**, **audio** and more **locally** with consumer grade hardware. |
30 | | -- **Agentic-first**: Extend LocalAI with LocalAGI, an autonomous AI agent platform that runs locally, no coding required. Build and deploy autonomous agents with ease. |
31 | | -- **Memory and Knowledge base**: Extend LocalAI with LocalRecall, A local rest api for semantic search and memory management. Perfect for AI applications. |
32 | | -- **OpenAI Compatible**: Drop-in replacement for OpenAI API. Compatible with existing applications and libraries. |
33 | | -- **No GPU Required**: Run on consumer grade hardware. No need for expensive GPUs or cloud services. |
34 | | -- **Multiple Models**: Support for various model families including LLMs, image generation, and audio models. Supports multiple backends for inferencing. |
35 | | -- **Privacy Focused**: Keep your data local. No data leaves your machine, ensuring complete privacy. |
36 | | -- **Easy Setup**: Simple installation and configuration. Get started in minutes with Binaries installation, Docker, Podman, Kubernetes or local installation. |
37 | | -- **Community Driven**: Active community support and regular updates. Contribute and help shape the future of LocalAI. |
38 | | - |
39 | | -## Quick Start |
40 | | - |
41 | | -**Docker is the recommended installation method** for most users: |
42 | | - |
43 | | -```bash |
44 | | -docker run -p 8080:8080 --name local-ai -ti localai/localai:latest |
45 | | -``` |
46 | | - |
47 | | -For complete installation instructions, see the [Installation guide](/installation/). |
48 | | - |
49 | | -## Get Started |
50 | | - |
51 | | -1. **[Install LocalAI](/installation/)** - Choose your installation method (Docker recommended) |
52 | | -2. **[Quickstart Guide](/getting-started/quickstart/)** - Get started quickly after installation |
53 | | -3. **[Install and Run Models](/getting-started/models/)** - Learn how to work with AI models |
54 | | -4. **[Try It Out](/getting-started/try-it-out/)** - Explore examples and use cases |
55 | | - |
56 | | -## Learn More |
57 | | - |
58 | | -- [Explore available models](https://models.localai.io) |
59 | | -- [Model compatibility](/model-compatibility/) |
60 | | -- [Try out examples](https://github.com/mudler/LocalAI-examples) |
61 | | -- [Join the community](https://discord.gg/uJAeKSAGDy) |
62 | | -- [Check the LocalAI Github repository](https://github.com/mudler/LocalAI) |
63 | | -- [Check the LocalAGI Github repository](https://github.com/mudler/LocalAGI) |
| 7 | +<div class="lai-home"> |
| 8 | + <section class="lai-hero"> |
| 9 | + <div class="lai-hero__copy"> |
| 10 | + <p class="lai-signal"><span></span> Open source · MIT licensed</p> |
| 11 | + <h1>One runtime.<br><strong>Every kind of AI.</strong><br>Your hardware.</h1> |
| 12 | + <p class="lai-hero__lede">LocalAI runs text, vision, speech, sound, images, video, embeddings, reranking, and autonomous agents behind one modular stack—from a CPU laptop to a distributed GPU cluster.</p> |
| 13 | + <div class="lai-actions"> |
| 14 | + <a class="lai-button" href="/installation/">Install LocalAI <b>→</b></a> |
| 15 | + <a class="lai-link" href="https://github.com/mudler/LocalAI">View on GitHub ↗</a> |
| 16 | + </div> |
| 17 | + <div class="lai-proof"><span>60+ backends</span><span>CPU to cluster</span><span>OpenAI · Anthropic · Ollama · ElevenLabs APIs</span></div> |
| 18 | + </div> |
| 19 | + </section> |
| 20 | + |
| 21 | + <section class="lai-breadth"> |
| 22 | + <header><p>The runtime, not just the endpoint.</p><h2>Bring the model. Choose the engine. Keep control.</h2></header> |
| 23 | + <div class="lai-lanes"> |
| 24 | + <a href="/features/text-generation/"><span>Reason</span><b>Language models · tools · structured output</b><em>Text</em></a> |
| 25 | + <a href="/features/openai-realtime/"><span>Listen & speak</span><b>Realtime WebRTC · transcription · TTS · diarization</b><em>Voice</em></a> |
| 26 | + <a href="/features/image-generation/"><span>Create</span><b>Images · video · music · sound</b><em>Media</em></a> |
| 27 | + <a href="/features/object-detection/"><span>See</span><b>Vision · detection · recognition · depth</b><em>Perception</em></a> |
| 28 | + <a href="/features/agents/"><span>Act</span><b>Agents · MCP · skills · RAG · interactive tools</b><em>Agentic</em></a> |
| 29 | + </div> |
| 30 | + </section> |
| 31 | + |
| 32 | + <section class="lai-architecture"> |
| 33 | + <div class="lai-architecture__copy"> |
| 34 | + <p>A small core, not a giant bundle.</p> |
| 35 | + <h2>Backends arrive when the model needs them.</h2> |
| 36 | + <p>LocalAI keeps the core lean. Each backend wraps a best-in-class engine—llama.cpp, vLLM, SGLang, MLX, whisper.cpp, diffusion engines, and many more—as an isolated service pulled on demand.</p> |
| 37 | + <ul><li>Install, update, or remove engines independently.</li><li>Mix CPU, NVIDIA, AMD, Intel, Apple Silicon, Vulkan, and Jetson.</li><li>Build your own backend in any language through an open gRPC contract.</li></ul> |
| 38 | + <a href="/reference/architecture/">Explore the architecture →</a> |
| 39 | + </div> |
| 40 | + <figure><img src="/images/diagrams/composable-core.png" alt="LocalAI's small core connected to independent on-demand model backends" /></figure> |
| 41 | + </section> |
| 42 | + |
| 43 | + <section class="lai-engines"> |
| 44 | + <div class="lai-engines__intro"> |
| 45 | + <p>We integrate the best engines. We build new ones, too.</p> |
| 46 | + <h2>Inference work that moves the open ecosystem forward.</h2> |
| 47 | + <p>The LocalAI team develops native C, C++, Rust, and GGML engines when the available stack is too heavy, too closed, or simply does not exist yet.</p> |
| 48 | + <a href="https://github.com/mudler/LocalAI#backends-built-by-us">See the engines we maintain ↗</a> |
| 49 | + </div> |
| 50 | + <div class="lai-engine-reel"> |
| 51 | + <div><span>Speech</span><b>parakeet.cpp</b><small>Streaming multilingual ASR</small></div> |
| 52 | + <div><span>Voice</span><b>vibevoice.cpp</b><small>Long-form TTS and ASR</small></div> |
| 53 | + <div><span>Identity</span><b>voice-detect.cpp</b><small>Speaker recognition and analysis</small></div> |
| 54 | + <div><span>Vision</span><b>face-detect.cpp</b><small>Recognition and anti-spoofing</small></div> |
| 55 | + <div><span>Perception</span><b>locate-anything.cpp</b><small>Open-vocabulary detection</small></div> |
| 56 | + <div><span>Privacy</span><b>privacy-filter.cpp</b><small>Native PII detection</small></div> |
| 57 | + <div><span>3D</span><b>free-splatter.cpp</b><small>Pose-free reconstruction</small></div> |
| 58 | + <div><span>Quantization</span><b>apex-quant</b><small>MoE-aware GGUF recipes</small></div> |
| 59 | + </div> |
| 60 | + </section> |
| 61 | + |
| 62 | + <section class="lai-scale"> |
| 63 | + <header><p>Start on one machine. Keep going.</p><h2>The same runtime from workstation to private AI fabric.</h2></header> |
| 64 | + <div class="lai-scale__path"> |
| 65 | + <div><span>01</span><b>Laptop</b><p>Run useful models locally, including CPU-only setups.</p></div> |
| 66 | + <div><span>02</span><b>Team server</b><p>Add authentication, API keys, roles, quotas, and usage visibility.</p></div> |
| 67 | + <div><span>03</span><b>Distributed cluster</b><p>Route across workers, fit models across devices, and scale with demand.</p></div> |
| 68 | + </div> |
| 69 | + </section> |
| 70 | + |
| 71 | + <section class="lai-platform"> |
| 72 | + <div><p>More than inference</p><h2>A complete local AI control plane.</h2></div> |
| 73 | + <div class="lai-platform__list"> |
| 74 | + <article><b>Agents built in</b><p>Create agents with MCP tools, skills, memory, RAG, citations, and streamed execution from the UI or API.</p></article> |
| 75 | + <article><b>Realtime by design</b><p>Build interruptible voice experiences with WebRTC, streaming STT, LLM output, and TTS.</p></article> |
| 76 | + <article><b>Privacy you can enforce</b><p>Keep data on your infrastructure and add PII analysis, redaction, policy middleware, and audit visibility.</p></article> |
| 77 | + <article><b>Models under your control</b><p>Discover capabilities, import models, fine-tune, quantize, route, and monitor them in one place.</p></article> |
| 78 | + </div> |
| 79 | + </section> |
| 80 | + |
| 81 | + <section class="lai-start"> |
| 82 | + <div><p>One command to begin</p><h2>Run your first local AI stack.</h2></div> |
| 83 | + <pre><code>docker run -ti --name local-ai -p 8080:8080 localai/localai:latest</code></pre> |
| 84 | + <div class="lai-start__links"><a href="/installation/">Installation options</a><a href="https://models.localai.io">Browse models</a><a href="/model-compatibility/">Compare backends</a><a href="https://discord.gg/uJAeKSAGDy">Join Discord</a></div> |
| 85 | + </section> |
| 86 | +</div> |
0 commit comments