]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
common : fix mirostat state when using multiple sequences (#3543)
authorKerfuffle <redacted>
Wed, 11 Oct 2023 19:35:46 +0000 (13:35 -0600)
committerGitHub <redacted>
Wed, 11 Oct 2023 19:35:46 +0000 (22:35 +0300)
commit70c29da118cdb02bfcbd0376c32b5b2236e48e48
tree9ba08e6a18d60e24b580d58b57f9c2b7a8848f3d
parent8c70a5ff25964f0a81e20d142a2f5ac5baff22fc
common : fix mirostat state when using multiple sequences (#3543)

* Fix mirostat state when using multiple sequences

* Fix mirostat by completely refactoring sampling!

* Try to fix zig build.

* Export function to fetch/create default sampler states

Code formatting cleanups and add some comments

Silence a warning about id not being used when logging is disabled

* Apply some renaming suggestions.

Fix comments that were out of sync with the pull.

* Use more consistant naming convention for sampling contexts
14 files changed:
Makefile
build.zig
common/CMakeLists.txt
common/common.cpp
common/common.h
common/sampling.cpp [new file with mode: 0644]
common/sampling.h [new file with mode: 0644]
examples/embd-input/embd-input-lib.cpp
examples/infill/infill.cpp
examples/main/main.cpp
examples/parallel/parallel.cpp
examples/save-load-state/save-load-state.cpp
examples/server/server.cpp
examples/speculative/speculative.cpp