]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: b32b332)
metal : add BF16 support (llama/8439)
authorGeorgi Gerganov <redacted>
Wed, 6 Nov 2024 17:53:51 +0000 (19:53 +0200)
committerGeorgi Gerganov <redacted>
Fri, 8 Nov 2024 06:32:11 +0000 (08:32 +0200)
commit5254eda8b9216e6d10dd7a4e1eb30544721e1316
treec2981a4a14e91bbbd90c756a24aff860f4ad0b0dtree
parentb32b332bfc5415a0c791fce216296556c2e0cd34commit | diff
metal : add BF16 support (llama/8439)

* ggml : add initial BF16 support

ggml-ci

* metal : add mul_mat_id BF16 support

ggml-ci

* metal : check for bfloat support on the Metal device

ggml-ci

* metal : better var names [no ci]

* metal : do not build bfloat kernels when not supported

ggml-ci

* metal : try to fix BF16 support check

ggml-ci

* metal : this should correctly check bfloat support
src/ggml-metal.m diff | blob | history
src/ggml-metal.metal diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/ggml