]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
eval-callback: Example how to use eval callback for debugging (#6576)
authorPierrick Hymbert <redacted>
Thu, 11 Apr 2024 12:51:07 +0000 (14:51 +0200)
committerGitHub <redacted>
Thu, 11 Apr 2024 12:51:07 +0000 (14:51 +0200)
commitb804b1ef77351d2a11be945462c6c251710476cb
treef963c03b90a54083ee67c22c882d20e388820897
parent8228b66dbc16290c5cbd70e80ab47c068e2569d8
eval-callback: Example how to use eval callback for debugging (#6576)

* gguf-debug: Example how to use ggml callback for debugging

* gguf-debug: no mutex, verify type, fix stride.

* llama: cv eval: move cb eval field in common gpt_params

* ggml_debug: use common gpt_params to pass cb eval.
Fix get tensor SIGV random.

* ggml_debug: ci: add tests

* ggml_debug: EOL in CMakeLists.txt

* ggml_debug: Remove unused param n_batch, no batching here

* ggml_debug: fix trailing spaces

* ggml_debug: fix trailing spaces

* common: fix cb_eval and user data not initialized

* ci: build revert label

* ggml_debug: add main test label

* doc: add a model: add a link to ggml-debug

* ggml-debug: add to make toolchain

* ggml-debug: tests add the main label

* ggml-debug: ci add test curl label

* common: allow the warmup to be disabled in llama_init_from_gpt_params

* ci: add curl test

* ggml-debug: better tensor type support

* gitignore : ggml-debug

* ggml-debug: printing also the sum of each tensor

* ggml-debug: remove block size

* eval-callback: renamed from ggml-debug

* eval-callback: fix make toolchain

---------

Co-authored-by: slaren <redacted>
Co-authored-by: Georgi Gerganov <redacted>
12 files changed:
.github/workflows/build.yml
.gitignore
Makefile
common/common.cpp
common/common.h
docs/HOWTO-add-model.md
examples/CMakeLists.txt
examples/eval-callback/CMakeLists.txt [new file with mode: 0644]
examples/eval-callback/README.md [new file with mode: 0644]
examples/eval-callback/eval-callback.cpp [new file with mode: 0644]
examples/imatrix/imatrix.cpp
llama.cpp