]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: a050c7d)
ggml-cuda: Add NVFP4 dp4a kernel (llama/20644)
authorMichael Wand <redacted>
Thu, 26 Mar 2026 08:54:03 +0000 (01:54 -0700)
committerGeorgi Gerganov <redacted>
Sun, 29 Mar 2026 12:04:36 +0000 (15:04 +0300)
commiteb747f3def7907b11b661a8af1450dd508fd6c9d
treeb722ebf6c8af521e6e2af662854f892080a51dbbtree
parenta050c7d1bf2aae985cba6896cdbb6644383f20bfcommit | diff
ggml-cuda: Add NVFP4 dp4a kernel (llama/20644)

Added check for dst_t to cuda_cast template for float
Restored ggml_cuda_ue4m3_to_fp32, changed vecdot ints to int32ts
Added CUDART/HIP Check and HIP/fp8 include
Added NVFP4 to Test-backend-ops
Added hip_fp8_e4m3 to __nv_fp8_e4m3 typedef

---------

Co-authored-by: Johannes Gäßler <redacted>
ggml/src/ggml-cuda/common.cuh diff | blob | history
ggml/src/ggml-cuda/convert.cu diff | blob | history
ggml/src/ggml-cuda/ggml-cuda.cu diff | blob | history
ggml/src/ggml-cuda/mmvq.cu diff | blob | history
ggml/src/ggml-cuda/vecdotq.cuh diff | blob | history
ggml/src/ggml-cuda/vendors/cuda.h diff | blob | history
ggml/src/ggml-cuda/vendors/hip.h diff | blob | history
Packaging of ggerganov/whisper.cpp