]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 0d9dda5)
ggml-hexagon: flash-attn opt (llama/19025)
authornullname <redacted>
Sat, 24 Jan 2026 06:02:07 +0000 (14:02 +0800)
committerGeorgi Gerganov <redacted>
Fri, 30 Jan 2026 13:56:40 +0000 (15:56 +0200)
commit79f1bb3d355c198e390f622555cb22225683a2bf
tree4b3ad798b9aaa797be1dd4744701baac1ed3ec47tree
parent0d9dda5a991afb0da39df3e1dce2e27928fac469commit | diff
ggml-hexagon: flash-attn opt (llama/19025)

* optimize flash attention kernel by improving score computation and online softmax update

* wip

* Refactor online softmax update in flash attention kernel for improved performance

* Optimize flash attention kernel by replacing float array with HVX_Vector for score computation

* wip
ggml/src/ggml-hexagon/htp/flash-attn-ops.c diff | blob | history
Packaging of ggerganov/whisper.cpp