]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama : fix Roberta embeddings (#10856)
authorSukriti Sharma <redacted>
Thu, 19 Dec 2024 13:04:51 +0000 (06:04 -0700)
committerGitHub <redacted>
Thu, 19 Dec 2024 13:04:51 +0000 (15:04 +0200)
commit2fffc52b50992ac5bc64db19d33c39cbc06f52cf
tree290e1f02740e1580a6ca62705e6189a0bcb42479
parent7585edbdebd02861e0994dae67c9338731fb3fc5
llama : fix Roberta embeddings (#10856)

* fix: Use gpt2 tokenizer for roberta and add eos/bos tokens

Branch: RobertaTokenizer

Signed-off-by: Gabe Goodhart <redacted>
* fixes to position embeddings

Signed-off-by: Sukriti-Sharma4 <redacted>
* map roberta-bpe to gpt-2

Signed-off-by: Sukriti-Sharma4 <redacted>
* fix linting

Signed-off-by: Sukriti-Sharma4 <redacted>
---------

Signed-off-by: Gabe Goodhart <redacted>
Signed-off-by: Sukriti-Sharma4 <redacted>
Co-authored-by: Gabe Goodhart <redacted>
convert_hf_to_gguf.py
src/llama.cpp