From: Xuan Son Nguyen Date: Wed, 11 Dec 2024 19:52:14 +0000 (+0100) Subject: server : (UI) add tok/s, get rid of completion.js (#10786) X-Git-Tag: upstream/0.0.4488~180 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=235f6e14bf0ed0211c51aeff14139038ae1000aa;p=pkg%2Fggml%2Fsources%2Fllama.cpp server : (UI) add tok/s, get rid of completion.js (#10786) * get rid of completion.js * extract chat bubble to a component * add tok/s info * sync * fix BASE_URL * only extract timings when it's enabled * fix auto scroll --- diff --git a/examples/server/public/index.html b/examples/server/public/index.html index 250729a4..9a19c5e8 100644 --- a/examples/server/public/index.html +++ b/examples/server/public/index.html @@ -11,84 +11,84 @@ 🦙 llama.cpp - chat - - + @@ -99,7 +99,7 @@ Server rendered element contains fewer child nodes than client vdom.`),T=!0),au(
-
+

Conversations

@@ -204,51 +204,25 @@ Server rendered element contains fewer child nodes than client vdom.`),T=!0),au( {{ messages.length === 0 ? 'Send a message to start' : '' }}
-
-
- - - - -
-
- - -
- - - - - -
+
-
-
- - -
+
+
@@ -311,6 +285,10 @@ Server rendered element contains fewer child nodes than client vdom.`),T=!0),au(
Advanced config
+
+ + Show tokens per second +
+ + + + +