drupol/wip-services-flake-llm

A Nix flake to run LLMs locally in a blink of an eye, without container but with privacy !

Services Flake LLM

A Nix flake to locally spawn the following services:

• Ollama
• Tika
• Searxng
• Open-WebUI

The services are spawned using process-compose.

The data are kept in the current directory you run the command.

To run it:

nix run github:drupol/wip-services-flake-llm

The services will be available at the following addresses:

• Ollama: http://localhost:11434
• Tika: http://localhost:9998
• Searxng: http://localhost:8080
• Open-WebUI: http://localhost:1111