From: Georgi Gerganov Date: Fri, 24 Mar 2023 21:47:06 +0000 (+0200) Subject: Disable BLAS altogether - the bug is not just for qunatized mat mul X-Git-Tag: gguf-v0.4.0~1120 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=8520fc310eab87f2c4612f2a00d4adbd44a20d0d;p=pkg%2Fggml%2Fsources%2Fllama.cpp Disable BLAS altogether - the bug is not just for qunatized mat mul --- diff --git a/ggml.c b/ggml.c index b428d705..db68ed14 100644 --- a/ggml.c +++ b/ggml.c @@ -5854,6 +5854,9 @@ static bool ggml_compute_forward_mul_mat_use_blas( const int ne0 = dst->ne[0]; const int ne1 = dst->ne[1]; + // TMP: disable BLAS for now there is definitely a bug + return false; + // TODO: find the optimal values for these if (ggml_is_contiguous(src0) && ggml_is_contiguous(src1) && ((ne0 >= 32 && ne1 >= 32 && ne10 >= 32))) {