From: Daniel Bevenius Date: Thu, 18 Apr 2024 16:47:17 +0000 (+0200) Subject: spec : fix typo in gguf.md (#798) X-Git-Tag: upstream/0.0.1642~767 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=e1daebbf9d38d510ba456c4d50b4500a73ac2b14;p=pkg%2Fggml%2Fsources%2Fggml spec : fix typo in gguf.md (#798) Signed-off-by: Daniel Bevenius --- diff --git a/docs/gguf.md b/docs/gguf.md index d6ad5e27..c2f95a2a 100644 --- a/docs/gguf.md +++ b/docs/gguf.md @@ -591,7 +591,7 @@ where N signifies the block number a layer belongs to, and where `BB` could be: - `ffn_up`: Feed-forward network "up" layer - `ffn_gate`: Feed-forward network "gate" layer - `ffn_down`: Feed-forward network "down" layer -- `ffn_gate_inp`: Expert-routing layer for the Fee-forward network in MoE models +- `ffn_gate_inp`: Expert-routing layer for the Feed-forward network in MoE models - `ffn_gate_exp`: Feed-forward network "gate" layer per expert in MoE models - `ffn_down_exp`: Feed-forward network "down" layer per expert in MoE models - `ffn_up_exp`: Feed-forward network "up" layer per expert in MoE models