Skip to content

Commit ed98327

Browse files
jjerphanggerganov
authored andcommitted
docs: Add instructions to install llama.cpp from conda-forge (#22219)
* docs: Add instructions to install `llama.cpp` from conda-forge Signed-off-by: Julien Jerphanion <git@jjerphan.xyz> * Rewording of instructions Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Signed-off-by: Julien Jerphanion <git@jjerphan.xyz> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
1 parent 9f2b23e commit ed98327

2 files changed

Lines changed: 31 additions & 3 deletions

File tree

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ LLM inference in C/C++
3737

3838
Getting started with llama.cpp is straightforward. Here are several ways to install it on your machine:
3939

40-
- Install `llama.cpp` using [brew, nix or winget](docs/install.md)
40+
- Install `llama.cpp` using [brew, nix, winget, or conda-forge](docs/install.md)
4141
- Run with Docker - see our [Docker documentation](docs/docker.md)
4242
- Download pre-built binaries from the [releases page](https://github.com/ggml-org/llama.cpp/releases)
4343
- Build from source by cloning this repository - check out [our build guide](docs/build.md)

docs/install.md

Lines changed: 30 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,40 @@
11
# Install pre-built version of llama.cpp
22

3-
| Install via | Windows | Mac | Linux |
4-
|-------------|---------|-----|-------|
3+
| Install via | Windows | Mac | Linux |
4+
|-------------|---------|------|-------|
5+
| conda-forge ||||
56
| Winget || | |
67
| Homebrew | |||
78
| MacPorts | || |
89
| Nix | |||
910

11+
## conda-forge (Windows, Mac and Linux)
12+
13+
conda-forge provides builds for:
14+
- CUDA (Windows and Linux)
15+
- Vulkan (Windows and Linux)
16+
- Apple Metal (macOS)
17+
18+
```sh
19+
conda install -c conda-forge llama-cpp
20+
```
21+
22+
```sh
23+
mamba install -c conda-forge llama-cpp
24+
```
25+
26+
```sh
27+
# Project-local installation
28+
pixi add llama-cpp
29+
30+
# Global installation
31+
pixi global install llama-cpp
32+
```
33+
34+
This distribution is managed on [`conda-forge/llama-cpp-feedstock`](https://github.com/conda-forge/llama.cpp-feedstock/).
35+
36+
Shall you have any problems, please open an issue on [its issue tracker](https://github.com/conda-forge/llama.cpp-feedstock/issues).
37+
1038
## Winget (Windows)
1139

1240
```sh

0 commit comments

Comments
 (0)