]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
CUDA: add BF16 support (llama/11093)
authorJohannes Gäßler <redacted>
Mon, 6 Jan 2025 01:33:52 +0000 (02:33 +0100)
committerGeorgi Gerganov <redacted>
Tue, 14 Jan 2025 08:38:01 +0000 (10:38 +0200)
commit341f5c28e637e9c23a10ee4f5b89e7fe70de2c01
tree5fd165c1f095314384646942f9dd463b651d68d0
parent537709952446c1f808579695a5625f25e8b77a94
CUDA: add BF16 support (llama/11093)

* CUDA: add BF16 support
ggml/src/ggml-cuda/convert.cu
ggml/src/ggml-cuda/ggml-cuda.cu
ggml/src/ggml-cuda/mmv.cu
ggml/src/ggml-cuda/vendors/cuda.h
ggml/src/ggml-cuda/vendors/hip.h
ggml/src/ggml-cuda/vendors/musa.h