]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Add quantize-stats command for testing quantization (#728)
authorunbounded <redacted>
Fri, 7 Apr 2023 22:09:18 +0000 (00:09 +0200)
committerGitHub <redacted>
Fri, 7 Apr 2023 22:09:18 +0000 (00:09 +0200)
commit62cfc54f77e519057110265b52b0d614fa363e2a
tree899b22495ef99e5e1661891c7ec0fd6de45aa43e
parent698f7b5d6316a1f8453b3b32fd0d637d24952ffd
Add quantize-stats command for testing quantization (#728)

Command that calculates some statistics over the errors introduced by
quantization, like mean square error, max error and some percentile errors for layer
weights. Should be useful for testing quantization improvements.

Exposes some internal state from ggml and llama for testing
.gitignore
Makefile
examples/CMakeLists.txt
examples/quantize-stats/CMakeLists.txt [new file with mode: 0644]
examples/quantize-stats/quantize-stats.cpp [new file with mode: 0644]
ggml.c
ggml.h
llama.cpp
llama.h