]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
add some new ops, fix some operators and add batch operations to certain operators...
authorleejet <redacted>
Sun, 3 Mar 2024 12:23:52 +0000 (20:23 +0800)
committerGeorgi Gerganov <redacted>
Mon, 4 Mar 2024 08:39:10 +0000 (10:39 +0200)
commit7d43c585dc174bb586775c22c15e5db9242b5b4b
tree660bf43a9745176fbc36c3086da90a5b304d4d7d
parent82f3e668adafba647de703f835991e91a96b5ac4
add some new ops, fix some operators and add batch operations to certain operators. (ggml/747)

* cuda: fix group_norm

* cuda: add batch inference support for ggml_pad/ggml_upscale

* add ggml_arrange

* add ggml_timestep_embedding

* update ggml_arange/ggml_timestep_embedding tests

* cuda: fix im2col

* add ggml_arange/ggml_timestep_embbeding support for metal backend

* fix some bugs

* fix some bugs

* Update ggml.h

Co-authored-by: Georgi Gerganov <redacted>
* Update ggml-cuda.cu

Co-authored-by: Georgi Gerganov <redacted>
* Update ggml-metal.m

Co-authored-by: Georgi Gerganov <redacted>
* Update ggml-metal.m

Co-authored-by: Georgi Gerganov <redacted>
* Update ggml-metal.metal

Co-authored-by: Georgi Gerganov <redacted>
* modify according to the review comments

* ggml : fix compile warnings + code style

* ggml : normalize compute_forward calls + fix seg fault in debug

* minor

---------

Co-authored-by: Georgi Gerganov <redacted>
Co-authored-by: slaren <redacted>
ggml-cuda.cu
ggml-metal.m
ggml-metal.metal
ggml.c
ggml.h
tests/test-backend-ops.cpp