]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
cuda, metal : fix nans in soft_max (llama/5574)
authorslaren <redacted>
Mon, 19 Feb 2024 08:04:45 +0000 (09:04 +0100)
committerGeorgi Gerganov <redacted>
Mon, 19 Feb 2024 13:52:51 +0000 (15:52 +0200)
commit458337d3444471a06d2eb7106daca3c82d692ec6
tree05b28ded5c2b984a85c2fe588060c43814c4654b
parent1aaa2afba0f0440fc2667a07eb25f01476076cb1
cuda, metal : fix nans in soft_max (llama/5574)

* cuda : fix nans in soft_max

* metal : fix nans in soft_max

---------

Co-authored-by: Georgi Gerganov <redacted>
src/ggml-cuda.cu
src/ggml-metal.metal