]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: c52d103)
CUDA: remove unnecessary warp reduce in FA (ggml/1032)
authormahorozte <redacted>
Tue, 3 Dec 2024 13:11:43 +0000 (21:11 +0800)
committerGeorgi Gerganov <redacted>
Sun, 8 Dec 2024 18:14:35 +0000 (20:14 +0200)
commit4af9626702537ba98bcb937b8de17a1ec538ff19
treec50c929698ac89e6677b8c91f32b19d321c49e48tree
parentc52d1035de6ddaa388f2a5d4bfd0713d447a4ae8commit | diff
CUDA: remove unnecessary warp reduce in FA (ggml/1032)

* kqmax_new_j in every thread within warp is same after operate at line 199,this reduce can be omit

* same problem in vec32

---------

Co-authored-by: ZhaoXiaoYu <redacted>
ggml/src/ggml-cuda/fattn-vec-f16.cuh diff | blob | history
ggml/src/ggml-cuda/fattn-vec-f32.cuh diff | blob | history
Packaging of ggerganov/whisper.cpp