From: Steve Grubb <redacted>
Date: Tue, 14 May 2024 14:11:24 +0000 (-0400)
Subject: server: free sampling contexts on exit (#7264)
X-Git-Tag: upstream/0.0.4488~1608
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=4f0263633b40e94e8b69fd6e7e4395cfedfd5c12;p=pkg%2Fggml%2Fsources%2Fllama.cpp

server: free sampling contexts on exit (#7264)

* server: free sampling contexts on exit

This cleans up last leak found by the address sanitizer.

* fix whitespace

* fix whitespace
---

diff --git a/examples/server/server.cpp b/examples/server/server.cpp
index ceaeb1f7..7e0d068f 100644
--- a/examples/server/server.cpp
+++ b/examples/server/server.cpp
@@ -671,6 +671,13 @@ struct server_context {
             model = nullptr;
         }
 
+        // Clear any sampling context
+        for (server_slot & slot : slots) {
+            if (slot.ctx_sampling != nullptr) {
+                llama_sampling_free(slot.ctx_sampling);
+            }
+        }
+
         llama_batch_free(batch);
     }