git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	0cc4m <redacted>
	Thu, 9 May 2024 18:39:54 +0000 (20:39 +0200)
committer	GitHub <redacted>
	Thu, 9 May 2024 18:39:54 +0000 (20:39 +0200)
commit	befddd0f15de6efb15d7e7f5b527dfb671f4196f
tree	7c0aa80c4b4f8fef76aa284982502a3bf8dae1d5	tree
parent	d46dbc76f8770caec0175f1e57777173c70556a0	commit \| diff

Vulkan Bugfixes and Improvements (#7084)

* Modify mat mat mul shader for mul_mat_id, modify mat vec mul shaders for single call batch operation

* Further work towards MoE, disabled for now

* Disable MoE code (not ready yet), fix a number of bugs in shaders and Vulkan code

* Add softmax with f16 mask and pos buffer support

* Disable mul_mat_id shaders for now

* Fix flake8

* Fix validation errors caused by empty buffers on larger batch sizes

ggml-vulkan-shaders.hpp		diff \| blob \| history
ggml-vulkan.cpp		diff \| blob \| history
ggml_vk_generate_shaders.py		diff \| blob \| history

Packaging of ggml-org/llama.cpp

RSS Atom