Skip to content

Commit 5d44db6

Browse files
server, webui: support continue generation on reasoning models (ggml-org#22727)
* server, webui : support continue generation on reasoning models (ggml-org#22727) Remove the throw blocking assistant prefill on reasoning models and orchestrate thinking tags around the prefilled message so the parser routes the next stream chunks correctly. WebUI drops the reasoning guard on the Continue button, sends reasoning_content with the prefilled message and persists partial reasoning on stop so the CoT survives reload and resume. Scope : templates with a simple thinking_start_tag / thinking_end_tag pair. Channel-based templates like GPT-OSS are out of scope, pending a per-template prefill API in common/chat. First step toward ggml-org#21754. * chore: update webui build output * server: reject reasoning prefill on channel based templates
1 parent 3796c94 commit 5d44db6

5 files changed

Lines changed: 249 additions & 192 deletions

File tree

0 commit comments

Comments
 (0)