]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml : fix overflows in elu function (llama/8866)
authorJustine Tunney <redacted>
Mon, 5 Aug 2024 12:43:40 +0000 (05:43 -0700)
committerGeorgi Gerganov <redacted>
Thu, 8 Aug 2024 10:45:29 +0000 (13:45 +0300)
commit15eac3295306f6dcfaecb74fe60f02b464f62462
tree84fbdbb0a2a730a8367ea15c95d6c9f3fe8b7ba3
parenta3b2059cacacd97985b4d814f464779d6e1545f2
ggml : fix overflows in elu function (llama/8866)

It's helpful to use expm1f(x), because expf(x)-1 will result in overflow
for 25% of single-precision floating point numbers.
src/ggml.c