]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)
authorTodor Boinovski <redacted>
Thu, 29 Jan 2026 20:33:21 +0000 (12:33 -0800)
committerGitHub <redacted>
Thu, 29 Jan 2026 20:33:21 +0000 (12:33 -0800)
commitce38a4db478b90542874cd4af5cb48b3a0fcf311
tree7d82acfafc669956dc9381b7affb5b3036799d6f
parent4fdbc1e4dba428ce0cf9d2ac22232dc170bbca82
hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)

* hexagon: updates to enable offloading to HTP on WoS

* Update windows.md

* Update windows.md

* hexagon: enable -O3 optimizations

* hexagon: move all _WINDOWS conditional compilation to _WIN32

* hexagon: updates to enable offloading to HTP on WoS

* hexagon: use run-time vs load-time dynamic linking for cdsp driver interface

* refactor htp-drv

* hexagon: add run-bench.ps1 script

* hexagon: htdrv refactor

* hexagon: unify Android and Windows build readmes

* hexagon: update README.md

* hexagon: refactor htpdrv

* hexagon: drv refactor

* hexagon: more drv refactor

* hexagon: fixes for android builds

* hexagon: factor out dl into ggml-backend-dl

* hexagon: add run-tool.ps1 script

* hexagon: merge htp-utils in htp-drv and remove unused code

* wos: no need for getopt_custom.h

* wos: add missing CR in htpdrv

* hexagon: ndev enforecement applies only to the Android devices

* hexagon: add support for generating and signing .cat file

* hexagon: add .inf file

* hexagon: working auto-signing and improved windows builds

* hexagon: futher improve skel build

* hexagon: add rough WoS guide

* hexagon: updated windows guide

* hexagon: improve cmake handling of certs and logging

* hexagon: improve windows setup/build doc

* hexagon: more windows readme updates

* hexagon: windows readme updates

* hexagon: windows readme updates

* hexagon: windows readme updates

* hexagon: windows readme updates

* Update windows.md

* Update windows.md

* snapdragon: rename docs/backend/hexagon to docs/backends/snapdragon

Also added a power shell script to simplify build env setup.

* hexagon: remove trailing whitespace and move cmake requirement to user-presets

* hexagon: fix CMakeUserPresets path in workflow yaml

* hexagon: introduce local version of libdl.h

* hexagon: fix src1 reuse logic

gpt-oss needs a bigger lookahead window.
The check for src[1] itself being quantized was wrong.

---------

Co-authored-by: Max Krasnyansky <redacted>
24 files changed:
.github/workflows/build.yml
docs/backend/hexagon/CMakeUserPresets.json [deleted file]
docs/backend/hexagon/README.md [deleted file]
docs/backend/hexagon/developer.md [deleted file]
docs/backend/snapdragon/CMakeUserPresets.json [new file with mode: 0644]
docs/backend/snapdragon/README.md [new file with mode: 0644]
docs/backend/snapdragon/developer.md [new file with mode: 0644]
docs/backend/snapdragon/windows.md [new file with mode: 0644]
ggml/src/CMakeLists.txt
ggml/src/ggml-backend-dl.cpp [new file with mode: 0644]
ggml/src/ggml-backend-dl.h [new file with mode: 0644]
ggml/src/ggml-backend-reg.cpp
ggml/src/ggml-hexagon/CMakeLists.txt
ggml/src/ggml-hexagon/ggml-hexagon.cpp
ggml/src/ggml-hexagon/htp-drv.cpp [new file with mode: 0644]
ggml/src/ggml-hexagon/htp-drv.h [new file with mode: 0644]
ggml/src/ggml-hexagon/htp-utils.c [deleted file]
ggml/src/ggml-hexagon/htp-utils.h [deleted file]
ggml/src/ggml-hexagon/libdl.h [new file with mode: 0644]
ggml/src/ggml-hexagon/libggml-htp.inf [new file with mode: 0644]
scripts/snapdragon/windows/run-bench.ps1 [new file with mode: 0644]
scripts/snapdragon/windows/run-cli.ps1 [new file with mode: 0644]
scripts/snapdragon/windows/run-tool.ps1 [new file with mode: 0644]
scripts/snapdragon/windows/setup-build.ps1 [new file with mode: 0644]