]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Allow viewing conversations even when llama server is down (#16255)
authorAleksander Grygier <redacted>
Fri, 26 Sep 2025 16:35:42 +0000 (18:35 +0200)
committerGitHub <redacted>
Fri, 26 Sep 2025 16:35:42 +0000 (18:35 +0200)
commit1a189278944d030211f336e103e96b65f976c361
treeb8fff78cc79b22f76696751e3ef01439f181900b
parente0539eb6aed346d4b25a6ea019044e88771e7690
Allow viewing conversations even when llama server is down (#16255)

* webui: allow viewing conversations and sending messages even if llama-server is down

- Cached llama.cpp server properties in browser localStorage on startup, persisting successful fetches and reloading them when refresh attempts fail so the chat UI continues to render while the backend is unavailable.
- Cleared the stored server properties when resetting the store to prevent stale capability data after cache-backed operation.
- Kept the original error-splash behavior when no cached props exist so fresh installs still surface a clear failure state instead of rendering stale data.

* feat: Add UI for `props` endpoint unavailable + cleanup logic

* webui: extend cached props fallback to offline errors

Treat connection failures (refused, DNS, timeout, fetch) the same way as
server 5xx so the warning banner shows up when cache is available, instead
of falling back to a full error screen.

* webui: Left the chat form enabled when a server warning is present so operators can keep sending messages

e.g., to restart the backend over llama-swap, even while cached /props data is in use

* chore: update webui build output

---------

Co-authored-by: Pascal <redacted>
tools/server/public/index.html.gz
tools/server/webui/src/lib/components/app/chat/ChatScreen/ChatScreen.svelte
tools/server/webui/src/lib/components/app/chat/ChatScreen/ChatScreenWarning.svelte [new file with mode: 0644]
tools/server/webui/src/lib/components/app/index.ts
tools/server/webui/src/lib/constants/localstorage-keys.ts [new file with mode: 0644]
tools/server/webui/src/lib/stores/server.svelte.ts
tools/server/webui/src/lib/utils/api-key-validation.ts