]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: b11f9ba)
metal : add BF16 support (#8439)
authorGeorgi Gerganov <redacted>
Wed, 6 Nov 2024 17:53:51 +0000 (19:53 +0200)
committerGitHub <redacted>
Wed, 6 Nov 2024 17:53:51 +0000 (19:53 +0200)
commit5c333e014059122245c318e7ed4ec27d1085573c
tree43c8395eb59aac863d4a78a3563756c6d6c08d5etree
parentb11f9ba9b8ce319f04b88afe40d264e6b7f4ba46commit | diff
metal : add BF16 support (#8439)

* ggml : add initial BF16 support

ggml-ci

* metal : add mul_mat_id BF16 support

ggml-ci

* metal : check for bfloat support on the Metal device

ggml-ci

* metal : better var names [no ci]

* metal : do not build bfloat kernels when not supported

ggml-ci

* metal : try to fix BF16 support check

ggml-ci

* metal : this should correctly check bfloat support
common/common.cpp diff | blob | history
ggml/src/ggml-metal.m diff | blob | history
ggml/src/ggml-metal.metal diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/llama.cpp