Commit 5bac16d
committed
fix(gallery): raise arch-router scoring output cap via parallel:64
Scoring decodes the whole prompt+candidate in a single llama_decode and
reads one logit row per candidate token. The vendored llama.cpp server
caps causal output rows at n_parallel, so the default of 1 aborts with
GGML_ASSERT(n_outputs_max <= cparams.n_outputs_max) on multi-token route
labels. Set options: [parallel:64] on both arch-router quant entries to
lift the cap; kv_unified (the grpc-server default) keeps the full context
per sequence, so this does not split the KV cache.
Assisted-by: claude-code:claude-opus-4-8 [Claude Code]
Signed-off-by: Richard Palethorpe <io@richiejp.com>1 parent c11791c commit 5bac16d
1 file changed
Lines changed: 11 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
24092 | 24092 | | |
24093 | 24093 | | |
24094 | 24094 | | |
| 24095 | + | |
| 24096 | + | |
| 24097 | + | |
| 24098 | + | |
| 24099 | + | |
| 24100 | + | |
| 24101 | + | |
| 24102 | + | |
24095 | 24103 | | |
24096 | 24104 | | |
24097 | 24105 | | |
| |||
24103 | 24111 | | |
24104 | 24112 | | |
24105 | 24113 | | |
| 24114 | + | |
| 24115 | + | |
| 24116 | + | |
24106 | 24117 | | |
24107 | 24118 | | |
24108 | 24119 | | |
| |||
0 commit comments