summaryrefslogtreecommitdiff
path: root/llama.cpp/docs/install.md
diff options
context:
space:
mode:
Diffstat (limited to 'llama.cpp/docs/install.md')
-rw-r--r--llama.cpp/docs/install.md50
1 files changed, 50 insertions, 0 deletions
diff --git a/llama.cpp/docs/install.md b/llama.cpp/docs/install.md
new file mode 100644
index 0000000..7200bf9
--- /dev/null
+++ b/llama.cpp/docs/install.md
@@ -0,0 +1,50 @@
+# Install pre-built version of llama.cpp
+
+| Install via | Windows | Mac | Linux |
+|-------------|---------|-----|-------|
+| Winget | ✅ | | |
+| Homebrew | | ✅ | ✅ |
+| MacPorts | | ✅ | |
+| Nix | | ✅ | ✅ |
+
+## Winget (Windows)
+
+```sh
+winget install llama.cpp
+```
+
+The package is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/issues/8188
+
+## Homebrew (Mac and Linux)
+
+```sh
+brew install llama.cpp
+```
+
+The formula is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/discussions/7668
+
+## MacPorts (Mac)
+
+```sh
+sudo port install llama.cpp
+```
+
+See also: https://ports.macports.org/port/llama.cpp/details/
+
+## Nix (Mac and Linux)
+
+```sh
+nix profile install nixpkgs#llama-cpp
+```
+
+For flake enabled installs.
+
+Or
+
+```sh
+nix-env --file '<nixpkgs>' --install --attr llama-cpp
+```
+
+For non-flake enabled installs.
+
+This expression is automatically updated within the [nixpkgs repo](https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/by-name/ll/llama-cpp/package.nix#L164).