]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
hexagon: HMX quantized matmul rework (llama/23368)
authorMax Krasnyansky <redacted>
Wed, 20 May 2026 14:39:01 +0000 (07:39 -0700)
committerGeorgi Gerganov <redacted>
Mon, 25 May 2026 09:26:07 +0000 (12:26 +0300)
commitb93a5ba605580e6dc05d4ee78f5894bfa6021ffc
treec1366337aa8ca1bb5aa825f4ca103ff110165136
parent3fa19558f223461fa30164384a65f592d63577ca
hexagon: HMX quantized matmul rework (llama/23368)

* hmx-mm: update debug logging in hmx-mm

* hmx-mm: update dequant logic to use HVX_vector_x2/4

* hmx-mm: remove non-pipelined version of the quantize matmul

It seems that we don't reall need non-pipelined version

* hmx-mm: use activation depth mode and update naming

Co-authored-by: Kim-Chyan Gan <redacted>
* hex-mm: minor hmx matmul naming updates

* hmx-mm: remove unused vars

* snapdragon: scripts bump default ubatch-size to 1K

* hexagon: combine HMX and power and clock settings into a single set_power call

* hmx-mm: remove leftover of the scale repl helper

* hexagon: fix editconf error

---------

Co-authored-by: Kim-Chyan Gan <redacted>
ggml/src/ggml-hexagon/htp/hmx-matmul-ops.c
ggml/src/ggml-hexagon/htp/hmx-ops.h
ggml/src/ggml-hexagon/htp/main.c
ggml/src/ggml-hexagon/htp/matmul-ops.c