]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
models : move the token embedding norms to the first layer (#20943)
authorGeorgi Gerganov <redacted>
Tue, 24 Mar 2026 15:00:30 +0000 (17:00 +0200)
committerGitHub <redacted>
Tue, 24 Mar 2026 15:00:30 +0000 (17:00 +0200)
commit9f102a1407ed5d73b8c954f32edab50f8dfa3f58
tree06b48df864c6d275c98eba567a09320d69453d0e
parent3fc6f1aed172602790e9088b57786109438c2466
models : move the token embedding norms to the first layer (#20943)

* models : move the token embedding norms to the first layer

* cont : fix LLM_TENSOR_CONV1D + fix il indexing
src/llama-arch.cpp
src/llama-model.cpp
src/models/bert.cpp
src/models/bloom.cpp
src/models/modern-bert.cpp
src/models/rwkv6.cpp
src/models/rwkv7.cpp
src/models/wavtokenizer-dec.cpp