Skip to content

Commit 3507069

Browse files
authored
Merge branch 'main' into llama-ui
2 parents efccb28 + a81b752 commit 3507069

2 files changed

Lines changed: 6 additions & 6 deletions

File tree

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ The stack includes:
3232

3333
| Parameter | Description | Default |
3434
| ---------------- | ------------------------------------------------------ | ------------------------------------ |
35-
| `HF_MODEL` | Hugging Face model repo ID containing `.gguf` files | `bartowski/Qwen_Qwen3.5-0.8B-GGUF` |
35+
| `HF_MODEL` | Hugging Face model repo ID containing `.gguf` files | `unsloth/SmolLM2-135M-Instruct-GGUF` |
3636
| `HF_MODEL_FILE` | Optional explicit GGUF filename | `""` |
3737
| `ENABLE_SVE` | Enable SVE optimizations | `OFF` |
3838

@@ -56,7 +56,7 @@ topo deploy --target <ip-address-of-target>
5656
Use a different model:
5757
```bash
5858
topo deploy --target <ip-address-of-target> \
59-
--arg HF_MODEL=unsloth/SmolLM2-135M-Instruct-GGUF
59+
--arg HF_MODEL=bartowski/Qwen_Qwen3.5-0.8B-GGUF
6060
```
6161

6262
Force an exact GGUF file:

compose.yaml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ services:
55
context: ./llama-inference
66
args:
77
ENABLE_SVE: OFF
8-
HF_MODEL: bartowski/Qwen_Qwen3.5-0.8B-GGUF
8+
HF_MODEL: unsloth/SmolLM2-135M-Instruct-GGUF
99
HF_MODEL_FILE: ""
1010
ports:
1111
- "8080:8080"
@@ -31,7 +31,7 @@ x-topo:
3131
- Built-in web chat interface
3232
- No GPU required - pure CPU inference
3333
34-
Perfect for demos and testing! The bundled Qwen3.5-0.8B model allows the
34+
Perfect for demos and testing! The bundled SmolLM2 135M model allows the
3535
project to run immediately without downloading additional models.
3636
3737
Ideal for testing LLM workloads on Arm hardware without GPU dependencies,
@@ -45,8 +45,8 @@ x-topo:
4545
args:
4646
HF_MODEL:
4747
description: "Hugging Face model repo ID containing a supported single-file GGUF model"
48-
default: "bartowski/Qwen_Qwen3.5-0.8B-GGUF"
49-
example: "unsloth/SmolLM2-135M-Instruct-GGUF"
48+
default: "unsloth/SmolLM2-135M-Instruct-GGUF"
49+
example: "bartowski/Qwen_Qwen3.5-0.8B-GGUF"
5050

5151
HF_MODEL_FILE:
5252
description: "Exact supported GGUF filename to download; sharded and mmproj files are rejected"

0 commit comments

Comments
 (0)