]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
opencl: support sink in `soft_max` (attn sinks) (llama/15152)
authorlhez <redacted>
Fri, 8 Aug 2025 04:47:03 +0000 (13:47 +0900)
committerGeorgi Gerganov <redacted>
Thu, 14 Aug 2025 11:17:28 +0000 (14:17 +0300)
commite283898fa96368900d732d7e236fcb26fdd73237
treebb1f108a1459bbd20bf91ea46905b1f6ac13f035
parentb5d7429f9d59654f8e425b050c3d3a3ece6c3f54
opencl: support sink in `soft_max` (attn sinks) (llama/15152)
src/ggml-opencl/ggml-opencl.cpp
src/ggml-opencl/kernels/softmax_4_f16.cl
src/ggml-opencl/kernels/softmax_4_f32.cl
src/ggml-opencl/kernels/softmax_f16.cl
src/ggml-opencl/kernels/softmax_f32.cl