]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml: move fp16/bf16 conversion optimizations to CPU backend + export conversion...
authorSXX <redacted>
Sat, 26 Apr 2025 14:05:31 +0000 (22:05 +0800)
committerGeorgi Gerganov <redacted>
Thu, 1 May 2025 10:29:02 +0000 (13:29 +0300)
commit46392f733f2b7dbfbd2e85a7d41a1e6fdb978c94
treed55e901d8c6432612ad9a6eff9e2ae5d26e0e800
parenteeb259909e150bd4a5c5a8d88159b1a8b705b812
ggml: move fp16/bf16 conversion optimizations to CPU backend + export conversion APIs (llama/13107)

* ggml: dynamic x86_64 feature detection for FP32 <-> FP16/BF16 conversion

* move fp converter to ggml-cpu

* Switch ggml_compute_forward_get_rows_f16/bf16 to new ggml_cpu_fp16/bf16_to_fp32
ggml/include/ggml-cpu.h
ggml/src/ggml-cpu/ggml-cpu.c
ggml/src/ggml-cpu/ops.cpp
ggml/src/ggml.c