]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
Avoid PDL race conditions by disabling __restrict__ when PDL is used (llama/24030)
authorAndreas Kieslinger <redacted>
Wed, 3 Jun 2026 11:56:42 +0000 (13:56 +0200)
committerGeorgi Gerganov <redacted>
Mon, 8 Jun 2026 11:36:36 +0000 (14:36 +0300)
commit00a9728de303c399f069dd1b0b7a33689ab3e56a
treeead6c607538ee754d037d115664cbd5d06341a6b
parent750fa4ca35c4b39a487724f854bfc788a2d9db53
Avoid PDL race conditions by disabling __restrict__ when PDL is used (llama/24030)

* Removes __restrict__ from PDL kernel headers due to incompatibility with
PDL. Adds preprocessor directives based on arch in kernel body to add
__restrict__ to retain performance on older architectures.

* Simplifies new __restrict__ usage via macro

* Add hopper to PDL __restrict__ fix.

Co-authored-by: Oliver Simons <redacted>
---------

Co-authored-by: Oliver Simons <redacted>
14 files changed:
ggml/src/ggml-cuda/common.cuh
ggml/src/ggml-cuda/fattn-common.cuh
ggml/src/ggml-cuda/fattn-mma-f16.cuh
ggml/src/ggml-cuda/fattn-tile.cuh
ggml/src/ggml-cuda/fattn-vec.cuh
ggml/src/ggml-cuda/fattn-wmma-f16.cu
ggml/src/ggml-cuda/getrows.cu
ggml/src/ggml-cuda/mmvf.cu
ggml/src/ggml-cuda/mmvq.cu
ggml/src/ggml-cuda/quantize.cu
ggml/src/ggml-cuda/reduce_rows.cuh
ggml/src/ggml-cuda/set-rows.cu
ggml/src/ggml-cuda/ssm-conv.cu
ggml/src/ggml-cuda/ssm-scan.cu