]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
CUDA: mul_mat_vec_q for batch sizes > 1 (llama/5351)
authorJohannes Gäßler <redacted>
Tue, 6 Feb 2024 13:44:06 +0000 (14:44 +0100)
committerGeorgi Gerganov <redacted>
Sat, 10 Feb 2024 07:55:47 +0000 (09:55 +0200)
commitb5dec374f49535f871cfc346ca8e6d6b6aaa343e
tree839434cfd4073f87bf5b4523df318f68e478dbcc
parentfa0dc6167ca6ace884793dbac4a5552201ca4a74
CUDA: mul_mat_vec_q for batch sizes > 1 (llama/5351)
ggml-cuda.cu