We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 471f5d1 commit 55ff41cCopy full SHA for 55ff41c
1 file changed
docs/speculative.md
@@ -33,9 +33,7 @@ llama-server -m Qwen3-4B.gguf -md Qwen3-4B-DFlash.gguf \
33
--spec-type draft-dflash --spec-draft-n-max 15 -fa on --jinja
34
```
35
36
-DFlash expects chat-formatted input (`--jinja`); setting `LLAMA_SPEC_NO_THINK=1` to disable
37
-"thinking" substantially raises the acceptance rate. `--spec-draft-n-max` is clamped to the draft
38
-model's trained block size.
+`--spec-draft-n-max` is clamped to the draft model's trained block size.
39
40
See:
41
0 commit comments