From: Georgi Gerganov Date: Sat, 11 Mar 2023 09:34:11 +0000 (+0200) Subject: Update README.md X-Git-Tag: gguf-v0.4.0~1290 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=ea977e85ecda7b983f0e7b1db20b509998ddc889;p=pkg%2Fggml%2Fsources%2Fllama.cpp Update README.md --- diff --git a/README.md b/README.md index 02b0c092..e6451722 100644 --- a/README.md +++ b/README.md @@ -2,9 +2,15 @@ Inference of [Facebook's LLaMA](https://github.com/facebookresearch/llama) model in pure C/C++ +**!!! IMPORTANT!!!** + +Commit [007a8f6f459c6eb56678fdee4c09219ddb85b640](https://github.com/ggerganov/llama.cpp/commit/007a8f6f459c6eb56678fdee4c09219ddb85b640) added support for all LLaMA models, but introduced breaking changes. If you generated any models before that commit, you must regenerate them after updating to latest master. + + **TEMPORARY NOTICE:** Currently the quantized models run **only** on Apple Silicon. On other architectures, you can [use the F16 models](https://github.com/ggerganov/llama.cpp/issues/2#issuecomment-1464615286), but they will be much slower. Support will be [added later](https://github.com/ggerganov/ggml/pull/27) + ## Description The main goal is to run the model using 4-bit quantization on a MacBook.