]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: request round-to-even for fp16 in im2col/rope_head (llama/10767)
authorJeff Bolz <redacted>
Tue, 10 Dec 2024 20:23:17 +0000 (14:23 -0600)
committerGeorgi Gerganov <redacted>
Tue, 17 Dec 2024 17:23:40 +0000 (19:23 +0200)
commitfd1e7ea8d0071406bde72ef26350e9e3af836384
tree2d90d103a52438699c177ec72d48e9aecb4cda76
parentff32488768685015f8be5f02e8387dc0629124ad
vulkan: request round-to-even for fp16 in im2col/rope_head (llama/10767)

Vulkan doesn't mandate a specific rounding mode, but the shader_float_controls
feature allows rounding mode to be requested if the implementation supports it.
src/ggml-vulkan/ggml-vulkan.cpp
src/ggml-vulkan/vulkan-shaders/im2col.comp
src/ggml-vulkan/vulkan-shaders/rope_head.comp
src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp