]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml-hexagon: gelu optimization (llama/18151)
authorShouyu <redacted>
Mon, 22 Dec 2025 18:56:52 +0000 (13:56 -0500)
committerGeorgi Gerganov <redacted>
Wed, 31 Dec 2025 15:52:09 +0000 (17:52 +0200)
commit2f3339519729f3821091bd342e2de633dd72d9f6
tree6b60c603bbb636201491cfb52ac4755fe468aab4
parent5b0c1c158049c02c5ed993f7634ebce4218645e5
ggml-hexagon: gelu optimization (llama/18151)

* feat: working gelu with src0 put on vtcm

* feat: gelu ping-pong for both in and out

* fix: fixu compile error

* break: distinguish dma ddr->vtcm and vtcm->ddr operation

* fix: fix dma queue size

* break: update dma api to either pop src or dst ptr

* fix: fix activation vtcm allocation issue for src1 when swapperd

* refactor: ping-pong gelu logic to avoid unnecessary if else

* dma: improved queue interface and prefetch handling

* gelu: fix N+2 block prefetch

---------

Co-authored-by: Max Krasnyansky <redacted>
ggml/src/ggml-hexagon/ggml-hexagon.cpp
ggml/src/ggml-hexagon/htp/act-ops.c
ggml/src/ggml-hexagon/htp/htp-dma.c
ggml/src/ggml-hexagon/htp/htp-dma.h
ggml/src/ggml-hexagon/htp/hvx-utils.h
ggml/src/ggml-hexagon/htp/main.c
ggml/src/ggml-hexagon/htp/matmul-ops.c