From: Bryan Honof Date: Mon, 17 Jun 2024 15:37:55 +0000 (+0200) Subject: Add Nix and Flox install instructions (#7899) X-Git-Tag: upstream/0.0.4488~1317 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=b473e95084c286780165568cf0f385f21141d68d;p=pkg%2Fggml%2Fsources%2Fllama.cpp Add Nix and Flox install instructions (#7899) --- diff --git a/README.md b/README.md index fd75a64b..54859946 100644 --- a/README.md +++ b/README.md @@ -387,6 +387,30 @@ brew install llama.cpp ``` The formula is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggerganov/llama.cpp/discussions/7668 +### Nix + +On Mac and Linux, the Nix package manager can be used via +``` +nix profile install nixpkgs#llama-cpp +``` +For flake enabled installs. + +Or +``` +nix-env --file '' --install --attr llama-cpp +``` +For non-flake enabled installs. + +This expression is automatically updated within the [nixpkgs repo](https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/by-name/ll/llama-cpp/package.nix#L164). + +#### Flox + +On Mac and Linux, Flox can be used to install llama.cpp within a Flox environment via +``` +flox install llama-cpp +``` +Flox follows the nixpkgs build of llama.cpp. + ### Metal Build On MacOS, Metal is enabled by default. Using Metal makes the computation run on the GPU.