diff options
Diffstat (limited to 'llama.cpp/docs/install.md')
| -rw-r--r-- | llama.cpp/docs/install.md | 50 |
1 files changed, 50 insertions, 0 deletions
diff --git a/llama.cpp/docs/install.md b/llama.cpp/docs/install.md new file mode 100644 index 0000000..7200bf9 --- /dev/null +++ b/llama.cpp/docs/install.md @@ -0,0 +1,50 @@ +# Install pre-built version of llama.cpp + +| Install via | Windows | Mac | Linux | +|-------------|---------|-----|-------| +| Winget | ✅ | | | +| Homebrew | | ✅ | ✅ | +| MacPorts | | ✅ | | +| Nix | | ✅ | ✅ | + +## Winget (Windows) + +```sh +winget install llama.cpp +``` + +The package is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/issues/8188 + +## Homebrew (Mac and Linux) + +```sh +brew install llama.cpp +``` + +The formula is automatically updated with new `llama.cpp` releases. More info: https://github.com/ggml-org/llama.cpp/discussions/7668 + +## MacPorts (Mac) + +```sh +sudo port install llama.cpp +``` + +See also: https://ports.macports.org/port/llama.cpp/details/ + +## Nix (Mac and Linux) + +```sh +nix profile install nixpkgs#llama-cpp +``` + +For flake enabled installs. + +Or + +```sh +nix-env --file '<nixpkgs>' --install --attr llama-cpp +``` + +For non-flake enabled installs. + +This expression is automatically updated within the [nixpkgs repo](https://github.com/NixOS/nixpkgs/blob/nixos-24.05/pkgs/by-name/ll/llama-cpp/package.nix#L164). |
