File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -32,7 +32,7 @@ The stack includes:
3232
3333| Parameter | Description | Default |
3434| ---------------- | ------------------------------------------------------ | ------------------------------------ |
35- | ` HF_MODEL ` | Hugging Face model repo ID containing ` .gguf ` files | ` bartowski/Qwen_Qwen3.5-0.8B- GGUF` |
35+ | ` HF_MODEL ` | Hugging Face model repo ID containing ` .gguf ` files | ` unsloth/SmolLM2-135M-Instruct- GGUF` |
3636| ` HF_MODEL_FILE ` | Optional explicit GGUF filename | ` "" ` |
3737| ` ENABLE_SVE ` | Enable SVE optimizations | ` OFF ` |
3838
@@ -56,7 +56,7 @@ topo deploy --target <ip-address-of-target>
5656Use a different model:
5757``` bash
5858topo deploy --target < ip-address-of-target> \
59- --arg HF_MODEL=unsloth/SmolLM2-135M-Instruct -GGUF
59+ --arg HF_MODEL=bartowski/Qwen_Qwen3.5-0.8B -GGUF
6060```
6161
6262Force an exact GGUF file:
Original file line number Diff line number Diff line change @@ -5,7 +5,7 @@ services:
55 context : ./llama-inference
66 args :
77 ENABLE_SVE : OFF
8- HF_MODEL : bartowski/Qwen_Qwen3.5-0.8B -GGUF
8+ HF_MODEL : unsloth/SmolLM2-135M-Instruct -GGUF
99 HF_MODEL_FILE : " "
1010 ports :
1111 - " 8080:8080"
@@ -31,7 +31,7 @@ x-topo:
3131 - Built-in web chat interface
3232 - No GPU required - pure CPU inference
3333
34- Perfect for demos and testing! The bundled Qwen3.5-0.8B model allows the
34+ Perfect for demos and testing! The bundled SmolLM2 135M model allows the
3535 project to run immediately without downloading additional models.
3636
3737 Ideal for testing LLM workloads on Arm hardware without GPU dependencies,
@@ -45,8 +45,8 @@ x-topo:
4545 args :
4646 HF_MODEL :
4747 description : " Hugging Face model repo ID containing a supported single-file GGUF model"
48- default : " bartowski/Qwen_Qwen3.5-0.8B -GGUF"
49- example : " unsloth/SmolLM2-135M-Instruct -GGUF"
48+ default : " unsloth/SmolLM2-135M-Instruct -GGUF"
49+ example : " bartowski/Qwen_Qwen3.5-0.8B -GGUF"
5050
5151 HF_MODEL_FILE :
5252 description : " Exact supported GGUF filename to download; sharded and mmproj files are rejected"
You can’t perform that action at this time.
0 commit comments