]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commitdiff
examples : add readme files
authorGeorgi Gerganov <redacted>
Wed, 29 Nov 2023 09:00:17 +0000 (11:00 +0200)
committerGeorgi Gerganov <redacted>
Wed, 29 Nov 2023 09:00:17 +0000 (11:00 +0200)
examples/lookahead/README.md [new file with mode: 0644]
examples/speculative/README.md [new file with mode: 0644]

diff --git a/examples/lookahead/README.md b/examples/lookahead/README.md
new file mode 100644 (file)
index 0000000..252a668
--- /dev/null
@@ -0,0 +1,7 @@
+# llama.cpp/examples/lookahead
+
+Demonstartion of lookahead decoding technique:
+
+https://lmsys.org/blog/2023-11-21-lookahead-decoding/
+
+More info: https://github.com/ggerganov/llama.cpp/pull/4207
diff --git a/examples/speculative/README.md b/examples/speculative/README.md
new file mode 100644 (file)
index 0000000..d88fd37
--- /dev/null
@@ -0,0 +1,8 @@
+# llama.cpp/examples/speculative
+
+Demonstartion of speculative decoding and tree-based speculative decoding techniques
+
+More info:
+
+- https://github.com/ggerganov/llama.cpp/pull/2926
+- https://github.com/ggerganov/llama.cpp/pull/3624