Commit dc9f50d
committed
fix(gallery): raise arch-router scoring output cap via parallel:64
Scoring decodes the whole prompt+candidate in a single llama_decode and
reads one logit row per candidate token. The vendored llama.cpp server
caps causal output rows at n_parallel, so the default of 1 aborts with
GGML_ASSERT(n_outputs_max <= cparams.n_outputs_max) on multi-token route
labels. Set options: [parallel:64] on both arch-router quant entries to
lift the cap; kv_unified (the grpc-server default) keeps the full context
per sequence, so this does not split the KV cache.
Assisted-by: claude-code:claude-opus-4-8 [Claude Code]
Signed-off-by: Richard Palethorpe <io@richiejp.com>1 parent a3054a2 commit dc9f50d
1 file changed
Lines changed: 11 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
24475 | 24475 | | |
24476 | 24476 | | |
24477 | 24477 | | |
| 24478 | + | |
| 24479 | + | |
| 24480 | + | |
| 24481 | + | |
| 24482 | + | |
| 24483 | + | |
| 24484 | + | |
| 24485 | + | |
24478 | 24486 | | |
24479 | 24487 | | |
24480 | 24488 | | |
| |||
24486 | 24494 | | |
24487 | 24495 | | |
24488 | 24496 | | |
| 24497 | + | |
| 24498 | + | |
| 24499 | + | |
24489 | 24500 | | |
24490 | 24501 | | |
24491 | 24502 | | |
| |||
0 commit comments