Skip to content

Use llama serve in Jobs serving guide (llama.cpp unified CLI) - #2593

Merged
davanstrien merged 2 commits into
huggingface:mainfrom
davanstrien:jobs-serving-llama-serve
Jun 30, 2026
Merged

Use llama serve in Jobs serving guide (llama.cpp unified CLI)#2593
davanstrien merged 2 commits into
huggingface:mainfrom
davanstrien:jobs-serving-llama-serve

Use lighter server-cuda image now that llama ships there (ggml-org/ll…

3f9c7ac
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
build / build_pr_documentation
succeeded Jun 29, 2026 in 51s