]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 2efc170)
gpt-2 : add comment about KV cache type (#1142)
authorbssrdf <redacted>
Thu, 13 Mar 2025 18:29:19 +0000 (14:29 -0400)
committerGitHub <redacted>
Thu, 13 Mar 2025 18:29:19 +0000 (20:29 +0200)
commitef094525080b661166f07a0d688fcfbf96e68e56
tree6e2719873ffa57f257b3f4e72d38b95c9e2a3819tree
parent2efc170b66649686addc760bee6d74381eb7c15ccommit | diff
gpt-2 : add comment about KV cache type (#1142)

* change KV cache to fp16 to take advantage of tensor cores

* added a note/comment to indicate kv can be FP16
examples/gpt-2/main-backend.cpp diff | blob | history
Packaging of ggml-org/ggml