]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml: bugfix: fix the inactive elements is agnostic for risc-v vector (llama/8748)
authorCarterLi999 <redacted>
Mon, 29 Jul 2024 16:38:34 +0000 (00:38 +0800)
committerGeorgi Gerganov <redacted>
Thu, 8 Aug 2024 10:45:29 +0000 (13:45 +0300)
commit4952391923859a6e401671f3f31d3c05284e8747
tree82de1c35a56813b1861e99cdd6a78080f6239736
parent116362ca26af294197aa4860461a1895102de2af
ggml: bugfix: fix the inactive elements is agnostic for risc-v vector (llama/8748)

In these codes, we want to retain the value that they previously held
when mask[i] is false. So we should use undisturbed. With the default
agnostic policy of rvv intrinsic, these values can be held or be
written with 1s.

Co-authored-by: carter.li <redacted>
src/ggml-quants.c