git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

opencl: transpose the K tile in local memory for FA prefill kernels (#26428)

ggml/src/ggml-opencl/ggml-opencl.cpp		diff \| blob \| history
ggml/src/ggml-opencl/kernels/flash_attn_f32_f16.cl		diff \| blob \| history
ggml/src/ggml-opencl/kernels/flash_attn_f32_q4_0.cl		diff \| blob \| history
ggml/src/ggml-opencl/kernels/flash_attn_f32_q8_0.cl		diff \| blob \| history

Packaging of ggml-org/llama.cpp