]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
hexagon: make vmem and buffer-size configurable (llama/22487)
authorMax Krasnyansky <redacted>
Wed, 29 Apr 2026 18:51:21 +0000 (11:51 -0700)
committerGeorgi Gerganov <redacted>
Fri, 1 May 2026 10:07:35 +0000 (13:07 +0300)
commit66392cf1a2624fb2688d10c835bdc178f669460b
tree05420d076508e64d117ea005bcdba231a6b08c90
parentaec8e69c2f1f78ea3872361b1483ba99ebf74468
hexagon: make vmem and buffer-size configurable (llama/22487)

* hexagon: allow host to set max vmem size

We use a sane default but it's helpful to allow for an override if needed.

* hexagon: add support for measuring vmem space and move pinned mmaping management to host

* hexagon: update vmem checks to use uint64

* hexagon: bump op buffers to 16 (matches max mmaps)

* hexagon: bump default vmem to 3.2GB

* hexagon: add support for autodetecting vmem space and some logging cleanup in that area

* hexagon: fix whitespace warnings

* Update scripts/snapdragon/adb/run-cli.sh

Co-authored-by: Pascal <redacted>
* hex-adb: fix run-completion script

---------

Co-authored-by: Pascal <redacted>
ggml/src/ggml-hexagon/ggml-hexagon.cpp
ggml/src/ggml-hexagon/htp/htp-ctx.h
ggml/src/ggml-hexagon/htp/htp-ops.h
ggml/src/ggml-hexagon/htp/htp_iface.idl
ggml/src/ggml-hexagon/htp/main.c