]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
Add support for soft_max ALiBi (llama/5639)
authorAidanBeltonS <redacted>
Mon, 26 Feb 2024 14:02:11 +0000 (14:02 +0000)
committerGeorgi Gerganov <redacted>
Wed, 28 Feb 2024 09:18:31 +0000 (11:18 +0200)
commit9dedee355ad3c3a19b512a13beba4f6388e61f27
tree30690762952268649a0d510f044663f18a2c89ce
parent4320f803eb108aaf9c69ab5d1880d1a2aefa4df2
Add support for soft_max ALiBi (llama/5639)

* Add support for bias

* Update pre-processor

* rm commented code

* fix format

* fix CI

---------

Co-authored-by: Abhilash Majumder <redacted>
src/ggml-sycl.cpp