]> git.djapps.eu Git - pkg/ggml/sources/ggml/commitdiff
stablelm : update README.md
authorGeorgi Gerganov <redacted>
Thu, 20 Apr 2023 20:35:52 +0000 (23:35 +0300)
committerGitHub <redacted>
Thu, 20 Apr 2023 20:35:52 +0000 (23:35 +0300)
examples/stablelm/README.md

index 7882d8b34957a983400cd7c8983964afd3d9088f..7a70ca720830556c105345e8c11430b65aace9af 100644 (file)
@@ -56,9 +56,9 @@ main:  predict time =  4474.07 ms / 63.92 ms per token
 main:    total time =  6911.26 ms
 ```
 
-## Run in 4-bit integer quantization mode
+## 4-bit integer quantization mode
 
-```
+```bash
 # quantize the model to 4-bits using Q4_3 quantization
 ./bin/stablelm-quantize ./stablelm-base-alpha-3b/ggml-model-f16.bin ./stablelm-base-alpha-3b/ggml-model-q4_3.bin 6