]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
cuda: Q1_0 initial backend (#21629)
authorPasha Khosravi <redacted>
Wed, 15 Apr 2026 16:38:38 +0000 (09:38 -0700)
committerGitHub <redacted>
Wed, 15 Apr 2026 16:38:38 +0000 (18:38 +0200)
commit7e72b38bc186deeee41b4d518a42bb50e1d0ba36
tree9bb615a45d8ccd43cc680004f6e710ed9e5a52d0
parent20d3bc2cc86a2ed79f5292b3012ec04792c54d4a
cuda: Q1_0 initial backend (#21629)

* [cuda] initial Q1_0 backend

* remove unused code, fix AMD MMA guard

* attempt to support dp4a

* Apply suggestions from code review

Co-authored-by: Johannes Gäßler <redacted>
---------

Co-authored-by: Johannes Gäßler <redacted>
ggml/src/ggml-cuda/common.cuh
ggml/src/ggml-cuda/convert.cu
ggml/src/ggml-cuda/dequantize.cuh
ggml/src/ggml-cuda/getrows.cu
ggml/src/ggml-cuda/ggml-cuda.cu
ggml/src/ggml-cuda/mmq.cu
ggml/src/ggml-cuda/mmq.cuh
ggml/src/ggml-cuda/mmvq.cu
ggml/src/ggml-cuda/template-instances/generate_cu_files.py
ggml/src/ggml-cuda/template-instances/mmq-instance-q1_0.cu [new file with mode: 0644]
ggml/src/ggml-cuda/vecdotq.cuh