From: WillCorticesAI <redacted>
Date: Tue, 26 Dec 2023 10:42:08 +0000 (-0500)
Subject: Update comment for AdamW implementation reference. (llama/4604)
X-Git-Tag: upstream/0.0.1642~1157
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=175434bd592409678f20cdf8c6e8b2131c5827d5;p=pkg%2Fggml%2Fsources%2Fggml

Update comment for AdamW implementation reference. (llama/4604)

Co-authored-by: Will Findley <redacted>
---

diff --git a/src/ggml.c b/src/ggml.c
index 73600ab0..d2456048 100644
--- a/src/ggml.c
+++ b/src/ggml.c
@@ -17456,9 +17456,9 @@ static void ggml_opt_acc_grad(int np, struct ggml_tensor * const ps[], float * g
 }
 
 //
-// ADAM
+// Using AdamW - ref: https://arxiv.org/pdf/1711.05101v3.pdf
 //
-//   ref: https://arxiv.org/pdf/1412.6980.pdf
+// (Original Adam - ref: https://arxiv.org/pdf/1412.6980.pdf)
 //
 
 static enum ggml_opt_result ggml_opt_adam(