From: Georgi Gerganov <redacted>
Date: Fri, 14 Jul 2023 08:13:55 +0000 (+0300)
Subject: ggml : fix mul_mat src1 indexing when not contiguous and non-F32 (#386)
X-Git-Tag: upstream/0.0.1642~1319
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=64d645ab55d461fbf2ce6b331f4fd01d59cdb04c;p=pkg%2Fggml%2Fsources%2Fggml

ggml : fix mul_mat src1 indexing when not contiguous and non-F32 (#386)
---

diff --git a/src/ggml.c b/src/ggml.c
index 256b8265..7a9f84ef 100644
--- a/src/ggml.c
+++ b/src/ggml.c
@@ -10836,7 +10836,7 @@ static void ggml_compute_forward_mul_mat(
         //       the original src1 data pointer, so we should index using the indices directly
         // TODO: this is a bit of a hack, we should probably have a better way to handle this
         const char * src1_col = (const char *) wdata +
-            (src1_cont
+            (src1_cont || src1->type != vec_dot_type
              ? (i11      + i12*ne11 + i13*ne12*ne11)*row_size
              : (i11*nb11 + i12*nb12 + i13*nb13));