From: Georgi Gerganov <redacted>
Date: Sat, 22 Feb 2025 10:46:31 +0000 (+0200)
Subject: server : disable Nagle's algorithm (#12020)
X-Git-Tag: upstream/0.0.4853~97
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=cf756d6e0a314e0fe25ff944341d79ea8c94cc96;p=pkg%2Fggml%2Fsources%2Fllama.cpp

server : disable Nagle's algorithm (#12020)
---

diff --git a/examples/server/utils.hpp b/examples/server/utils.hpp
index 6f8ab2b9..4db4c783 100644
--- a/examples/server/utils.hpp
+++ b/examples/server/utils.hpp
@@ -7,6 +7,8 @@
 
 // increase max payload length to allow use of larger context size
 #define CPPHTTPLIB_FORM_URL_ENCODED_PAYLOAD_MAX_LENGTH 1048576
+// disable Nagle's algorithm
+#define CPPHTTPLIB_TCP_NODELAY true
 #include "httplib.h"
 
 // Change JSON_ASSERT from assert() to GGML_ASSERT: