]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 6c37e9b)
ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (llama/9217)
authorCharles Xu <redacted>
Wed, 25 Sep 2024 13:12:20 +0000 (15:12 +0200)
committerGeorgi Gerganov <redacted>
Sun, 29 Sep 2024 18:17:39 +0000 (21:17 +0300)
commit2a2484cc39cce8698b0afe73371934efb13f9471
tree9ea210e13a0709ba2bd3e9113c1d28f4c8491732tree
parent6c37e9bb741260b09aabe7abd64d93ebabc6d664commit | diff
ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (llama/9217)

* ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels

* added fallback mechanism when the offline re-quantized model is not
optimized for the underlying target.

* fix for build errors

* remove prints from the low-level code

* Rebase to the latest upstream
src/ggml-aarch64.c diff | blob | history
Packaging of ggml-org/ggml