]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: request round-to-even for fp16 in im2col/rope_head (llama/10767)
authorJeff Bolz <redacted>
Tue, 10 Dec 2024 20:23:17 +0000 (14:23 -0600)
committerGeorgi Gerganov <redacted>
Wed, 18 Dec 2024 10:52:16 +0000 (12:52 +0200)
commit479bd7716944e48d77e6f562cb28fda468518816
tree9c2ecabdcf8d5dd9a9bd0d72874952f677bd9398
parentd8bf63a41b934eed168a486904cb2e57e01dff38
vulkan: request round-to-even for fp16 in im2col/rope_head (llama/10767)

Vulkan doesn't mandate a specific rounding mode, but the shader_float_controls
feature allows rounding mode to be requested if the implementation supports it.
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/im2col.comp
ggml/src/ggml-vulkan/vulkan-shaders/rope_head.comp
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp