]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama/ggml: add LLM training support (#10544)
authorJohannes Gäßler <redacted>
Mon, 12 May 2025 12:44:49 +0000 (14:44 +0200)
committerGitHub <redacted>
Mon, 12 May 2025 12:44:49 +0000 (14:44 +0200)
commit10d2af0eaa0aafd7c6577b279dfa5221ff44a63f
treecbeacf669e12d14e4b44fff1f5836a149744fa85
parent064cc596ac44308dc326a17c9e3163c34a6f29d1
llama/ggml: add LLM training support (#10544)

* llama/ggml: add LLM training support

more compact progress bar

llama_save_model_to_file

llama_opt_param_filter

ggml_graph_dup force_grads

refactor ggml_opt, fix test-opt

* remove logits_all

* refactor CUDA implementation for ACC

* reset graph at beginning of opt period
31 files changed:
build-xcframework.sh
common/common.cpp
common/common.h
examples/CMakeLists.txt
examples/training/CMakeLists.txt [new file with mode: 0644]
examples/training/README.md [new file with mode: 0644]
examples/training/finetune.cpp [new file with mode: 0644]
ggml/include/ggml-opt.h
ggml/include/ggml.h
ggml/src/ggml-backend.cpp
ggml/src/ggml-cuda/acc.cu
ggml/src/ggml-cuda/sum.cu
ggml/src/ggml-opt.cpp
ggml/src/ggml.c
include/llama.h
src/CMakeLists.txt
src/llama-context.cpp
src/llama-context.h
src/llama-graph.cpp
src/llama-graph.h
src/llama-model-loader.cpp
src/llama-model-saver.cpp [new file with mode: 0644]
src/llama-model-saver.h [new file with mode: 0644]
src/llama-model.cpp
src/llama-model.h
src/llama-quant.cpp
src/llama-vocab.cpp
src/llama-vocab.h
src/llama.cpp
tests/test-backend-ops.cpp
tests/test-opt.cpp