]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
tokenize example: Respect normal add BOS token behavior (#4126)
authorKerfuffle <redacted>
Sat, 18 Nov 2023 21:48:17 +0000 (14:48 -0700)
committerGitHub <redacted>
Sat, 18 Nov 2023 21:48:17 +0000 (14:48 -0700)
commit28a2e6e7d476717881be6eb9e2d3331342cec57b
tree19c9ea98490818264fd3c585492002eaca9eadae
parent0b5c3b04572a05f80163a365070fb377a837ac27
tokenize example: Respect normal add BOS token behavior (#4126)

Allow building with Makefile
Makefile
examples/tokenize/tokenize.cpp