From: bsilvereagle <redacted>
Date: Sun, 2 Apr 2023 22:13:03 +0000 (-0700)
Subject: Remove torch GPU dependencies from the Docker.full image (#665)
X-Git-Tag: gguf-v0.4.0~1023
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=a0c05164168297c04737936ad0cad849a512547a;p=pkg%2Fggml%2Fsources%2Fllama.cpp

Remove torch GPU dependencies from the Docker.full image (#665)

By using `pip install torch --index-url https://download.pytorch.org/whl/cpu`
instead of `pip install torch` we can specify we want to install a CPU-only version
of PyTorch without any GPU dependencies. This reduces the size of the Docker image
from 7.32 GB to 1.62 GB
---

diff --git a/.devops/full.Dockerfile b/.devops/full.Dockerfile
index 2b3a20c6..a75bc976 100644
--- a/.devops/full.Dockerfile
+++ b/.devops/full.Dockerfile
@@ -6,7 +6,8 @@ RUN apt-get update && \
     apt-get install -y build-essential python3 python3-pip
 
 RUN pip install --upgrade pip setuptools wheel \
-    && pip install numpy requests sentencepiece torch tqdm
+    && pip install numpy requests sentencepiece tqdm \
+    && pip install torch --index-url https://download.pytorch.org/whl/cpu
 
 WORKDIR /app