]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
hexagon: minor refresh for HMX FA and MM (#23796)
authorMax Krasnyansky <redacted>
Thu, 28 May 2026 11:49:11 +0000 (04:49 -0700)
committerGitHub <redacted>
Thu, 28 May 2026 11:49:11 +0000 (04:49 -0700)
commita91900113415ebf3b25e75a8b75fe475876e139a
treea97fa2cb4fee32e6747b9c7bf5370fd98f87f34e
parent48e7078ee08d56d22b81fc9aaefd8cb9fac4c3e2
hexagon:  minor refresh for HMX FA and MM (#23796)

* hex-fa: clean up qf32/fp32 handling and stride handling

* hex-fa: fix corner case fp NAN issues that were cause bad output from gemma4 on v79

* hex-fa: vectorize leftover handling

* hex-fa: avoid HVX fallback during token gen HMX has more FP16 compute capacity

* hmx-mm: remove dead code

* hmx-mm: use fastdiv in x4x2 dequant

* hmx-mm: sandwich dequant and scatter to improve perf

* hmx-mm: fixed rebase conflicts

* hmx-mm: further improve weight dequant by doing early type dispatch and precomputing fastdiv

* hmx-mm: an even earlier dispatch for per-type dequant

* hmx-mm: dequant linear types like q4_0 and q4_1 without the LUTs

This is a bit faster than LUT.

* hex-cmake: one more tweak for lto

---------

Co-authored-by: Trivikram Reddy <redacted>
ggml/src/ggml-hexagon/htp/CMakeLists.txt
ggml/src/ggml-hexagon/htp/flash-attn-ops.c
ggml/src/ggml-hexagon/htp/hmx-flash-attn-ops.c
ggml/src/ggml-hexagon/htp/hmx-matmul-ops.c