]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commitdiff
Update README.md
authorGeorgi Gerganov <redacted>
Fri, 10 Mar 2023 23:22:58 +0000 (01:22 +0200)
committerGitHub <redacted>
Fri, 10 Mar 2023 23:22:58 +0000 (01:22 +0200)
README.md

index e7e7cb2a9edce0d93e9343577639b363c926dee2..3734383be1ad0df06bf1faa5f0509dd6f20a3dbc 100644 (file)
--- a/README.md
+++ b/README.md
@@ -5,6 +5,8 @@ Inference of [Facebook's LLaMA](https://github.com/facebookresearch/llama) model
 **TEMPORARY NOTICE:**
 If you observe garbage results, make sure to update to latest master. There was a bug and it was fixed here: https://github.com/ggerganov/llama.cpp/commit/70bc0b8b15b98dca23b28f0c8f5e34b27e424cda
 
+Also, currently the quantized models run **only** on Apple Silicon. On other architectures, you can [use the F16 models](https://github.com/ggerganov/llama.cpp/issues/2#issuecomment-1464615286), but they will be much slower. Support will be [added later](https://github.com/ggerganov/ggml/pull/27)
+
 ## Description
 
 The main goal is to run the model using 4-bit quantization on a MacBook.