]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 11182fa)
Allow all RDNA2 archs to use sdot4 intrinsic (llama/8629)
authorJeroen Mostert <redacted>
Tue, 23 Jul 2024 08:50:40 +0000 (10:50 +0200)
committerGeorgi Gerganov <redacted>
Thu, 8 Aug 2024 19:48:46 +0000 (22:48 +0300)
commit86506b0c5ccfdc59d19dc24830341c89a68b9cd2
treeb6952e70ee8c61231e0a5834a9ca90f7d040337btree
parent11182fae341227ac796b19b733518a3499f41bc2commit | diff
Allow all RDNA2 archs to use sdot4 intrinsic (llama/8629)

The check gating the use of `__builtin_amdgc_sdot4` specifically checks for gfx1030. This causes a severe perf regression for anything gfx103? that's not gfx1030 and not using `HSA_OVERRIDE_GFX_VERSION` (if you've built ROCm to support it). We already have a generic RDNA2 define, let's use it.
ggml/src/ggml-cuda/common.cuh diff | blob | history
Packaging of ggerganov/whisper.cpp