]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 2a1c455)
Vulkan Embedding Fix (llama/7360)
author0cc4m <redacted>
Sun, 19 May 2024 15:19:53 +0000 (17:19 +0200)
committerGeorgi Gerganov <redacted>
Tue, 28 May 2024 11:41:08 +0000 (14:41 +0300)
commit8c2bb4cd8ca10df5ac12e06b99dcfe381596a427
treed45458f2e319c58675e33c8c7d00e5afe42adbfctree
parent2a1c455d32393d4dcb580cdebd2d9404aa32c434commit | diff
Vulkan Embedding Fix (llama/7360)

* Fix empty Vulkan host buffers

Add fp32 fp16 matmul shader

Fix matmul shader alignment

* Remove deprecated tensor->backend uses

* Fix Vulkan validation errors on embedding models with no offloaded layers

* Fix Vulkan llava segfault when not offloading layers
src/ggml-vulkan.cpp diff | blob | history
Packaging of ggml-org/ggml