]>
git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
sycl: fix row calculation when K_QUANTS_PER_ITERATION is 1 (#25690)
* sycl: fix incorrect row calculation when K_QUANTS_PER_ITERATION=1
Signed-off-by: Todd Malsbary <redacted>
* sycl: use K_QUANTS_PER_ITERATION for non-reordered Q5_K kernel
This is the only Q5_K kernel that was not using KQPI.
Signed-off-by: Todd Malsbary <redacted>
* sycl: add missing second half processing to reordered q5_k
Error found while running
GGML_SYCL_PRIORITIZE_DMMV=1 \
build/bin/test-backend-ops test -o MUL_MAT
Signed-off-by: Todd Malsbary <redacted>
* sycl: fix potential off-by-one error
Signed-off-by: Todd Malsbary <redacted>
* sycl: fix missing row > nrows check
Signed-off-by: Todd Malsbary <redacted>
---------
Signed-off-by: Todd Malsbary <redacted>