]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
ggml : fix BLAS with unsupported types (#9775)
authorDiego Devesa <redacted>
Tue, 8 Oct 2024 12:21:43 +0000 (14:21 +0200)
committerGitHub <redacted>
Tue, 8 Oct 2024 12:21:43 +0000 (14:21 +0200)
commitdca1d4b58a7f1acf1bd253be84e50d6367f492fd
tree89e396b66d36a403eabede80008dbc7137b30472
parent458367a90606448a9c0262b276947c9e536086e0
ggml : fix BLAS with unsupported types (#9775)

* ggml : do not use BLAS with types without to_float

* ggml : return pointer from ggml_internal_get_type_traits to avoid unnecessary copies

* ggml : rename ggml_internal_get_type_traits -> ggml_get_type_traits

it's not really internal if everybody uses it
13 files changed:
examples/export-lora/export-lora.cpp
examples/quantize-stats/quantize-stats.cpp
ggml/include/ggml.h
ggml/src/ggml-backend.cpp
ggml/src/ggml-blas.cpp
ggml/src/ggml-vulkan.cpp
ggml/src/ggml.c
pocs/vdot/q8dot.cpp
pocs/vdot/vdot.cpp
src/llama.cpp
tests/test-backend-ops.cpp
tests/test-quantize-fns.cpp
tests/test-quantize-perf.cpp