]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 1dbaefd)
SYCL: Add mrope kernel (llama/13755)
authorAkarshan Biswas <redacted>
Fri, 30 May 2025 14:10:57 +0000 (19:40 +0530)
committerGeorgi Gerganov <redacted>
Sun, 1 Jun 2025 11:01:05 +0000 (14:01 +0300)
commit320be747d0ee62c78a189772203a1ff73c102ea8
treed1a6a6cb4c0a31e02858d41938aacecd87d7bfa5tree
parent1dbaefd7aa50993a841de5827942d15ee8c600f8commit | diff
SYCL: Add mrope kernel (llama/13755)

* SYCL: Add mrope kernel

* feat: Optimize rope operations with vectorization

Uses `sycl::vec` to load and store two elements at a time,
significantly improving performance in `rope_norm`,
`rope_neox`, and `rope_multi`. This reduces the number of memory
accesses and leverages SIMD instructions for faster execution.

* Use ceil_div
src/ggml-sycl/ggml-sycl.cpp diff | blob | history
src/ggml-sycl/rope.cpp diff | blob | history
Packaging of ggml-org/ggml