]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 1893359)
SYCL: Add mrope kernel (llama/13755)
authorAkarshan Biswas <redacted>
Fri, 30 May 2025 14:10:57 +0000 (19:40 +0530)
committerGeorgi Gerganov <redacted>
Sun, 1 Jun 2025 12:14:44 +0000 (15:14 +0300)
commitf7f92d0aabd89e4001ad6a87456b161dc748d0a6
tree4bdf8b3408aa95dd71430a81463b2156cdb00c57tree
parent1893359cfdb350df6c065be0f95c61c425cc7404commit | diff
SYCL: Add mrope kernel (llama/13755)

* SYCL: Add mrope kernel

* feat: Optimize rope operations with vectorization

Uses `sycl::vec` to load and store two elements at a time,
significantly improving performance in `rope_norm`,
`rope_neox`, and `rope_multi`. This reduces the number of memory
accesses and leverages SIMD instructions for faster execution.

* Use ceil_div
ggml/src/ggml-sycl/ggml-sycl.cpp diff | blob | history
ggml/src/ggml-sycl/rope.cpp diff | blob | history
Packaging of ggerganov/whisper.cpp