From: Pavol Rusnak <redacted>
Date: Sat, 18 Mar 2023 20:58:46 +0000 (+0100)
Subject: Add memory/disk requirements to readme
X-Git-Tag: gguf-v0.4.0~1218
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=554b54152145c30618bac171efb712cf4a7d1e96;p=pkg%2Fggml%2Fsources%2Fllama.cpp

Add memory/disk requirements to readme
---

diff --git a/README.md b/README.md
index 808d54e8..fc8b2fda 100644
--- a/README.md
+++ b/README.md
@@ -155,7 +155,17 @@ python3 convert-pth-to-ggml.py models/7B/ 1
 
 When running the larger models, make sure you have enough disk space to store all the intermediate files.
 
-TODO: add model disk/mem requirements
+### Memory/Disk Requirements
+
+As the models are currently fully loaded into memory, you will need adequate disk space to save them
+and sufficient RAM to load them. At the moment, memory and disk requirements are the same.
+
+| model | original size | quantized size (4-bit) |
+|-------|---------------|------------------------|
+| 7B    | 13 GB         | 3.9 GB                 |
+| 15B   | 24 GB         | 7.8 GB                 |
+| 30B   | 60 GB         | 19.5 GB                |
+| 65B   | 120 GB        | 38.5 GB                |
 
 ### Interactive mode