]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
Vulkan Embedding Fix (llama/7360)
author0cc4m <redacted>
Sun, 19 May 2024 15:19:53 +0000 (17:19 +0200)
committerGeorgi Gerganov <redacted>
Sun, 16 Jun 2024 15:19:48 +0000 (18:19 +0300)
commit67919cfe11f0b6a27b0a242d812374e5fc48d1c7
treec84e986960cb8281150b1b579203bcdc7cc980a4
parentbf5fc81a8a3ad3e63415ce707f0fdb7113ec4772
Vulkan Embedding Fix (llama/7360)

* Fix empty Vulkan host buffers

Add fp32 fp16 matmul shader

Fix matmul shader alignment

* Remove deprecated tensor->backend uses

* Fix Vulkan validation errors on embedding models with no offloaded layers

* Fix Vulkan llava segfault when not offloading layers
ggml-vulkan.cpp