]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server, webui: support continue generation on reasoning models (#22727)
authorPascal <redacted>
Wed, 13 May 2026 09:09:51 +0000 (11:09 +0200)
committerGitHub <redacted>
Wed, 13 May 2026 09:09:51 +0000 (11:09 +0200)
commit5d44db60089b0381cdbf7c45ce9ded43fc0c7f4c
treec04224ea441317aae0cb82563efadf71cc272a7f
parent3796c94bad989f82d16594b5202e8adb51b979a4
server, webui: support continue generation on reasoning models (#22727)

* server, webui : support continue generation on reasoning models (#22727)

Remove the throw blocking assistant prefill on reasoning models and
orchestrate thinking tags around the prefilled message so the parser
routes the next stream chunks correctly. WebUI drops the reasoning
guard on the Continue button, sends reasoning_content with the
prefilled message and persists partial reasoning on stop so the CoT
survives reload and resume.

Scope : templates with a simple thinking_start_tag / thinking_end_tag
pair. Channel-based templates like GPT-OSS are out of scope, pending
a per-template prefill API in common/chat.

First step toward #21754.

* chore: update webui build output

* server: reject reasoning prefill on channel based templates
tools/server/public/bundle.js
tools/server/server-common.cpp
tools/server/webui/src/lib/components/app/chat/ChatMessages/ChatMessage/ChatMessageAssistant/ChatMessageAssistant.svelte
tools/server/webui/src/lib/constants/settings-registry.ts
tools/server/webui/src/lib/stores/chat.svelte.ts