]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml : reuse quantum structs across backends (llama/5943)
authorGeorgi Gerganov <redacted>
Tue, 12 Mar 2024 12:27:20 +0000 (14:27 +0200)
committerGeorgi Gerganov <redacted>
Fri, 15 Mar 2024 12:01:13 +0000 (14:01 +0200)
commit46e3c3f1121dc181b9a067027b79ce95940f79ab
tree5e8bc2d55d5d61e0c7795076e4ede2c688d1fbfd
parentef24ae0c7dae4e14c1caba8baf9de02a66cee094
ggml : reuse quantum structs across backends (llama/5943)

* ggml : reuse quant blocks across backends

ggml-ci

* ggml : define helper constants only for CUDA and SYCL

ggml-ci

* ggml : define helper quantum constants for SYCL

ggml-ci
ggml-cuda.cu
ggml-metal.m
ggml-metal.metal
ggml-quants.c
ggml-quants.h
ggml-sycl.cpp