git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

Dequant improvements rebase (#8255)

* Single load for half2

* Store scales in local mem

* Vec load quantized values

ggml/src/ggml-sycl/common.hpp		diff \| blob \| history
ggml/src/ggml-sycl/convert.cpp		diff \| blob \| history
ggml/src/ggml-sycl/dequantize.hpp		diff \| blob \| history

Packaging of ggml-org/llama.cpp