From: Daniel Bevenius <redacted>
Date: Sun, 27 Jul 2025 10:10:51 +0000 (+0200)
Subject: llama : clarify comment about pp and tg graphs [no ci] (#14895)
X-Git-Tag: upstream/0.0.6073~70
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=ca0ef2dddb022cb1337d775cd05cd27d7808aff4;p=pkg%2Fggml%2Fsources%2Fllama.cpp

llama : clarify comment about pp and tg graphs [no ci] (#14895)

* llama : clarify comment about pp and tg graphs [no ci]

This commit clarifies the comment in `llama-context.cpp` regarding the
prefill prompt (pp), and token generation (tg) graphs.

The motivation for this is that I've struggled to remember these and had
to look them up more than once, so I thought it would be helpful to add
a comment that makes it clear what these stand for.

* squash! llama : clarify comment about pp and tg graphs [no ci]

Change "pp" to "prompt processing".
---

diff --git a/src/llama-context.cpp b/src/llama-context.cpp
index 84f9ccab..9e77fe6d 100644
--- a/src/llama-context.cpp
+++ b/src/llama-context.cpp
@@ -298,7 +298,7 @@ llama_context::llama_context(
 
         cross.v_embd.clear();
 
-        // reserve pp graph first so that buffers are only allocated once
+        // reserve pp (prompt processing) graph first so that buffers are only allocated once
         {
             auto * gf = graph_reserve(n_tokens, n_seqs, n_tokens, mctx.get());
             if (!gf) {
@@ -309,7 +309,7 @@ llama_context::llama_context(
             n_nodes_pp  = ggml_graph_n_nodes(gf);
         }
 
-        // reserve with tg graph to get the number of splits and nodes
+        // reserve with tg (token generation) graph to get the number of splits and nodes
         {
             auto * gf = graph_reserve(n_seqs, n_seqs, n_seqs, mctx.get());
             if (!gf) {