]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 5fe6d36)
ggml: move fp16/bf16 conversion optimizations to CPU backend + export conversion...
authorSXX <redacted>
Sat, 26 Apr 2025 14:05:31 +0000 (22:05 +0800)
committerGeorgi Gerganov <redacted>
Thu, 1 May 2025 07:39:34 +0000 (10:39 +0300)
commitef1205f038c87d5ff1aa41eeedf251b55bfd1be6
tree28cc5b2d172483761197282e273a1a0693b9cc09tree
parent5fe6d362244c8bfb5175bb4059a4f848da492affcommit | diff
ggml: move fp16/bf16 conversion optimizations to CPU backend + export conversion APIs (llama/13107)

* ggml: dynamic x86_64 feature detection for FP32 <-> FP16/BF16 conversion

* move fp converter to ggml-cpu

* Switch ggml_compute_forward_get_rows_f16/bf16 to new ggml_cpu_fp16/bf16_to_fp32
include/ggml-cpu.h diff | blob | history
src/ggml-cpu/ggml-cpu.c diff | blob | history
src/ggml-cpu/ops.cpp diff | blob | history
src/ggml.c diff | blob | history
Packaging of ggml-org/ggml