]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml-hexagon: gelu optimization (llama/18151)
authorShouyu <redacted>
Mon, 22 Dec 2025 18:56:52 +0000 (13:56 -0500)
committerGeorgi Gerganov <redacted>
Wed, 31 Dec 2025 10:39:43 +0000 (12:39 +0200)
commit85750fc74a66cdd059ae63449867fe05fdfc621e
tree3953a9c537c1f52d17b1cd4ef8dac5ea0dea88ad
parent1ee02800005432b4dbd50a59e29ab4e2e8214acd
ggml-hexagon: gelu optimization (llama/18151)

* feat: working gelu with src0 put on vtcm

* feat: gelu ping-pong for both in and out

* fix: fixu compile error

* break: distinguish dma ddr->vtcm and vtcm->ddr operation

* fix: fix dma queue size

* break: update dma api to either pop src or dst ptr

* fix: fix activation vtcm allocation issue for src1 when swapperd

* refactor: ping-pong gelu logic to avoid unnecessary if else

* dma: improved queue interface and prefetch handling

* gelu: fix N+2 block prefetch

---------

Co-authored-by: Max Krasnyansky <redacted>
src/ggml-hexagon/ggml-hexagon.cpp
src/ggml-hexagon/htp/act-ops.c
src/ggml-hexagon/htp/htp-dma.c
src/ggml-hexagon/htp/htp-dma.h
src/ggml-hexagon/htp/hvx-utils.h
src/ggml-hexagon/htp/main.c
src/ggml-hexagon/htp/matmul-ops.c