From: Austin <redacted>
Date: Wed, 10 Jan 2024 13:39:09 +0000 (-0500)
Subject: llama : recognize 1B phi models (#4847)
X-Git-Tag: upstream/0.0.4488~2680
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=329ff615699d32f596d4ebf8baba654c30064e0d;p=pkg%2Fggml%2Fsources%2Fllama.cpp

llama : recognize 1B phi models (#4847)

This update categorizes models with 24 layers as MODEL_1B, ensuring compatibility with different Phi model variants without impacting existing Phi-2 model functionality.
---

diff --git a/llama.cpp b/llama.cpp
index 8e0717db..0f09d0c2 100644
--- a/llama.cpp
+++ b/llama.cpp
@@ -2829,6 +2829,7 @@ static void llm_load_hparams(
                 ml.get_key(LLM_KV_ATTENTION_LAYERNORM_EPS, hparams.f_norm_eps);
 
                 switch (hparams.n_layer) {
+                    case 24: model.type = e_model::MODEL_1B; break;
                     case 32: model.type = e_model::MODEL_3B; break;
                     default: model.type = e_model::MODEL_UNKNOWN;
                 }