]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
Dequant improvements rebase (llama/8255)
authorAidanBeltonS <redacted>
Wed, 3 Jul 2024 01:55:34 +0000 (02:55 +0100)
committerGeorgi Gerganov <redacted>
Mon, 8 Jul 2024 10:03:28 +0000 (13:03 +0300)
commit51644ebe4bdac37129dd8aca372393903178a43c
tree9c364a3f2fd7f12e8498eb781ea48c0636b8a772
parent4bb9e17e3db32685419722da0d8ea8f3b56e42e1
Dequant improvements rebase (llama/8255)

* Single load for half2

* Store scales in local mem

* Vec load quantized values
src/ggml-sycl/common.hpp
src/ggml-sycl/convert.cpp
src/ggml-sycl/dequantize.hpp