]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
CANN: Fix SOC_TYPE compile bug (llama/10519)
authorleo-pony <redacted>
Thu, 28 Nov 2024 07:25:24 +0000 (15:25 +0800)
committerGeorgi Gerganov <redacted>
Tue, 3 Dec 2024 19:05:37 +0000 (21:05 +0200)
commitd22c42e74dc2d9af4816f0263fe396e742a9df18
tree3d55ada5119a31cdf1da01263e790a31156938ef
parent93dcec9845df70587a58b5c40924468452818414
CANN: Fix SOC_TYPE compile bug (llama/10519)

* CANN: Fix the bug build fail on Ascend310P under two cases:
1) Manual specify SOC_TYPE
2) Under some unusual compile environment

* Update the cann backend News content: Support F16 and F32 data type model for Ascend 310P NPU.

* fix CANN  compile fail bug: the assert in ascend kernel function doesn't supportted on some CANN version
src/ggml-cann/CMakeLists.txt
src/ggml-cann/kernels/CMakeLists.txt
src/ggml-cann/kernels/dup.cpp
src/ggml-cann/kernels/get_row_q4_0.cpp
src/ggml-cann/kernels/quantize_f16_q8_0.cpp
src/ggml-cann/kernels/quantize_f32_q8_0.cpp
src/ggml-cann/kernels/quantize_float_to_q4_0.cpp