Skip to content

Commit 40d35c0

Browse files
localai-botmudler
andauthored
docs: onboarding overhaul, dedup, and error docs (#7711) (#10895)
* docs: fix CPU image tag (latest, not latest-cpu) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: use canonical localai/localai registry in models guide Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: replace dead llama-stable backend with llama-cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: correct mitm-proxy intercept config and redaction tier Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fix text-to-audio endpoint and broken notice block Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fix VAD example, stale FAQ, broken link, CLI list, whats-new dump Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: render advanced/reference section indexes (consolidate _index) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove duplicate getting-started build/kubernetes pages Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fold container image reference into installation/containers Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove stale advanced fine-tuning page (superseded by features/fine-tuning) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: fold distribution/longcat/sound pages into their parents Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: make getting-started index accurate and complete Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: carry one concrete model through the getting-started path Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add end-to-end 'build your first agent' walkthrough Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add runtime errors reference; consolidate troubleshooting from FAQ Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add agent actions catalog Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: agent-scoped MCP, skills walkthrough, agentic disambiguation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add concrete gallery install lines to media feature pages Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: merge installation into getting-started (URLs preserved via aliases) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add Operations section; move operator pages and P2P API reference Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: journey-ordered top nav and grouped feature sections Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: add docs-with-code process gate (PR template + agent instructions) Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: remove em/en dashes from documentation prose Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
1 parent d3ea65a commit 40d35c0

86 files changed

Lines changed: 1838 additions & 2120 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.agents/coding-style.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -65,6 +65,7 @@ This is enforced by `forbidigo` (see `.golangci.yml`): `http.DefaultClient` and
6565

6666
The project documentation is located in `docs/content`. When adding new features or changing existing functionality, it is crucial to update the documentation to reflect these changes. This helps users understand how to use the new capabilities and ensures the documentation stays relevant.
6767

68+
- **Docs-with-code rule**: When you change user-facing behavior (API endpoints, CLI flags, config keys, or features), update the corresponding page under `docs/content/` in the SAME change, not as a follow-up. A user-facing change without a matching docs update is incomplete. The PR template carries a checklist item for this.
6869
- **Feature Documentation**: If you add a new feature (like a new backend or API endpoint), create a new markdown file in `docs/content/features/` explaining what it is, how to configure it, and how to use it.
6970
- **Configuration**: If you modify configuration options, update the relevant sections in `docs/content/`.
7071
- **Examples**: providing concrete examples (like YAML configuration blocks) is highly encouraged to help users get started quickly.

.github/PULL_REQUEST_TEMPLATE.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,7 @@ This PR fixes #
77

88
**[Signed commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)**
99
- [ ] Yes, I signed my commits.
10+
- [ ] Documentation updated (docs/content/) for user-facing changes, or not applicable
1011

1112
<!--
1213
Thank you for contributing to LocalAI!

AGENTS.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ LocalAI follows the Linux kernel project's [guidelines for AI coding assistants]
3939
- **Logging**: Use `github.com/mudler/xlog` (same API as slog)
4040
- **Go style**: Prefer `any` over `interface{}`
4141
- **Comments**: Explain *why*, not *what*
42-
- **Docs**: Update `docs/content/` when adding features or changing config
42+
- **Docs (docs-with-code rule)**: When you change user-facing behavior (API endpoints, CLI flags, config keys, or features), update the corresponding page under `docs/content/` in the SAME change, not as a follow-up. A user-facing change without a matching docs update is incomplete. See also the documentation conventions in [.agents/coding-style.md](.agents/coding-style.md).
4343
- **New API endpoints**: LocalAI advertises its capability surface in several independent places — swagger `@Tags`, `/api/instructions` registry, auth `RouteFeatureRegistry`, React UI `capabilities.js`, docs. Read [.agents/api-endpoints-and-auth.md](.agents/api-endpoints-and-auth.md) and follow its checklist — missing any surface means clients, admins, and the UI won't know the endpoint exists.
4444
- **Admin endpoints → MCP tool**: every admin endpoint that an admin would manage conversationally (install/list/edit/toggle/upgrade) MUST also be exposed as an MCP tool in `pkg/mcp/localaitools/`. The LocalAI Assistant chat modality and the standalone `local-ai mcp-server` consume that package; drift between REST and MCP is a real risk. Read [.agents/localai-assistant-mcp.md](.agents/localai-assistant-mcp.md) — the `TestToolHTTPRouteMappingComplete` test fails until you wire the new tool and update the route map.
4545
- **Build**: Inspect `Makefile` and `.github/workflows/` — ask the user before running long builds

docs/content/_index.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ type = "home"
99
<div class="lai-hero__copy">
1010
<p class="lai-signal"><span></span> Open source · MIT licensed</p>
1111
<h1>One runtime.<br><strong>Every kind of AI.</strong><br>Your hardware.</h1>
12-
<p class="lai-hero__lede">LocalAI runs text, vision, speech, sound, images, video, embeddings, reranking, and autonomous agents behind one modular stackfrom a CPU laptop to a distributed GPU cluster.</p>
12+
<p class="lai-hero__lede">LocalAI runs text, vision, speech, sound, images, video, embeddings, reranking, and autonomous agents behind one modular stack-from a CPU laptop to a distributed GPU cluster.</p>
1313
<div class="lai-actions">
1414
<a class="lai-button" href="/installation/">Install LocalAI <b>→</b></a>
1515
<a class="lai-link" href="https://github.com/mudler/LocalAI">View on GitHub ↗</a>
@@ -33,7 +33,7 @@ type = "home"
3333
<div class="lai-architecture__copy">
3434
<p>A small core, not a giant bundle.</p>
3535
<h2>Backends arrive when the model needs them.</h2>
36-
<p>LocalAI keeps the core lean. Each backend wraps a best-in-class enginellama.cpp, vLLM, SGLang, MLX, whisper.cpp, diffusion engines, and many moreas an isolated service pulled on demand.</p>
36+
<p>LocalAI keeps the core lean. Each backend wraps a best-in-class engine-llama.cpp, vLLM, SGLang, MLX, whisper.cpp, diffusion engines, and many more-as an isolated service pulled on demand.</p>
3737
<ul><li>Install, update, or remove engines independently.</li><li>Mix CPU, NVIDIA, AMD, Intel, Apple Silicon, Vulkan, and Jetson.</li><li>Build your own backend in any language through an open gRPC contract.</li></ul>
3838
<a href="/reference/architecture/">Explore the architecture →</a>
3939
</div>

docs/content/advanced/_index.en.md

Lines changed: 103 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
weight: 20
2+
weight: 5
33
title: "Advanced"
44
description: "Advanced usage"
55
type: chapter
@@ -9,4 +9,105 @@ date: 2020-10-06T08:49:15+00:00
99
lastmod: 2020-10-06T08:49:15+00:00
1010
draft: false
1111
images: []
12-
---
12+
---
13+
14+
## Overview
15+
16+
The **Advanced** section covers in-depth topics for users who want to fully leverage LocalAI's capabilities beyond basic usage. These pages are designed for developers, DevOps engineers, and power users who need fine-grained control over model configuration, system resources, and deployment infrastructure.
17+
18+
### Who Should Read This Section
19+
20+
- **Developers** integrating LocalAI into applications
21+
- **DevOps Engineers** deploying LocalAI in production
22+
- **ML Engineers** optimizing model performance
23+
- **System Administrators** managing multi-user installations
24+
25+
---
26+
27+
## Topics
28+
29+
### 🚀 [Advanced Usage](advanced-usage.md)
30+
Comprehensive guide to advanced LocalAI features including multi-modal inference, custom backends, and extended API capabilities.
31+
32+
**Key topics:**
33+
- Multi-modal model support
34+
- Custom backend integration
35+
- Advanced API endpoints
36+
- Request/response customization
37+
38+
**Recommended for:** Developers extending LocalAI functionality
39+
40+
---
41+
42+
### 🎯 [Model Configuration](model-configuration.md)
43+
Complete reference for model configuration files, parameters, and optimization settings.
44+
45+
**Key topics:**
46+
- Configuration file format
47+
- Model-specific parameters
48+
- Quantization settings
49+
- Performance tuning
50+
51+
**Recommended for:** ML engineers optimizing model behavior
52+
53+
---
54+
55+
### 🔒 [Reverse Proxy & TLS](reverse-proxy-tls.md)
56+
Complete guide to securing LocalAI deployments with reverse proxies and TLS certificates.
57+
58+
**Key topics:**
59+
- Nginx/Apache configuration
60+
- TLS certificate setup
61+
- Authentication layers
62+
- Production hardening
63+
64+
**Recommended for:** DevOps engineers deploying to production
65+
66+
---
67+
68+
### 💾 [VRAM Management](vram-management.md)
69+
Advanced techniques for managing GPU memory and optimizing parallel inference.
70+
71+
**Key topics:**
72+
- GPU memory allocation
73+
- Multi-model loading
74+
- Batch processing
75+
- Resource scheduling
76+
77+
**Recommended for:** Users running multiple models on limited hardware
78+
79+
---
80+
81+
## Quick Links
82+
83+
| Task | Documentation |
84+
|------|---------------|
85+
| Configure a model | [Model Configuration](model-configuration.md) |
86+
| Deploy securely | [Reverse Proxy & TLS](reverse-proxy-tls.md) |
87+
| Optimize VRAM usage | [VRAM Management](vram-management.md) |
88+
| Extend functionality | [Advanced Usage](advanced-usage.md) |
89+
90+
---
91+
92+
## Prerequisites
93+
94+
Before diving into advanced topics, ensure you have:
95+
96+
1. ✅ Completed the [Getting Started](../getting-started/) guide
97+
2. ✅ Successfully run LocalAI with a basic model
98+
3. ✅ Basic understanding of command-line interfaces
99+
4. ✅ Familiarity with YAML configuration (for most topics)
100+
101+
---
102+
103+
## Related Sections
104+
105+
- 📚 [Reference](../reference/) - API documentation and command reference
106+
- 🔌 [Installation](../installation/) - Deployment options and requirements
107+
-[Features](../features/) - Overview of LocalAI capabilities
108+
109+
---
110+
111+
## Navigation
112+
113+
[Getting Started](../getting-started/) | [Reference](../reference/)

docs/content/advanced/_index.md

Lines changed: 0 additions & 126 deletions
This file was deleted.

docs/content/advanced/advanced-usage.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ parameters:
2020

2121
context_size: 512
2222
threads: 10
23-
backend: llama-stable
23+
backend: llama-cpp
2424

2525
template:
2626
completion: completion
@@ -140,7 +140,7 @@ parameters:
140140
# Relative to the models path
141141
model: ...
142142
143-
backend: llama-stable
143+
backend: llama-cpp
144144
```
145145

146146
### Connect external backends

0 commit comments

Comments
 (0)