diff options
| author | Mitja Felicijan <mitja.felicijan@gmail.com> | 2026-02-20 14:13:15 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2026-02-20 14:13:15 +0100 |
| commit | 809f5def0c3a49c10d41a8e2165192fe5fa938da (patch) | |
| tree | 146eb1f600eebba65545f58aae244a4982db294f /README.md | |
| parent | 98af38c5a3e00d0843677bd044203b7a91172134 (diff) | |
| download | llmnpc-master.tar.gz | |
Expanded project description to include embedding models, vector database creation, and local inference details.
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 9 |
1 files changed, 9 insertions, 0 deletions
@@ -1,5 +1,14 @@ An experiment using tiny LLMs as NPCs that could be embedded into the game. +Embed models into the game, build a simple vector database from text, embed +prompts, retrieve top‑k by cosine similarity, and feed context into tiny +CPU LLMs for NPC interactions. + +**No external API calls.** Everything is local, directly using GGUF models +and [llama.cpp](https://github.com/ggml-org/llama.cpp) for inference. + +https://github.com/user-attachments/assets/863b75eb-0da7-4235-8112-f00bc82d81f6 + > [!NOTE] > This project is just for fun, to see how LLMs would fare as NPCs. Because of > the non-deterministic nature of LLMs, the results vary and are often quite |
