git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Georgi Gerganov <redacted>
	Mon, 11 Mar 2024 15:47:47 +0000 (17:47 +0200)
committer	GitHub <redacted>
	Mon, 11 Mar 2024 15:47:47 +0000 (17:47 +0200)
commit	83796e62bc9f6caae6228168e359890f51e60fee
tree	30ea49ae9b8fbde216ca164200bea1df44e18df3	tree
parent	828defefb66fc8a25404f5de845897145bf34061	commit \| diff

llama : refactor unicode stuff (#5992)

* llama : refactor unicode stuff

ggml-ci

* unicode : names

* make : fix c++ compiler

* unicode : names

* unicode : straighten tables

* zig : fix build

* unicode : put nfd normalization behind API

ggml-ci

* swift : fix build

* unicode : add BOM

* unicode : add <cstdint>

ggml-ci

* unicode : pass as cpts as const ref

CMakeLists.txt		diff \| blob \| history
Makefile		diff \| blob \| history
Package.swift		diff \| blob \| history
build.zig		diff \| blob \| history
llama.cpp		diff \| blob \| history
tests/test-tokenizer-1-bpe.cpp		diff \| blob \| history
tests/test-tokenizer-1-llama.cpp		diff \| blob \| history
unicode.cpp	[new file with mode: 0644]	blob
unicode.h		diff \| blob \| history

Packaging of ggml-org/llama.cpp

RSS Atom