/try-ollama

Primary LanguageMakefileGNU Affero General Public License v3.0AGPL-3.0

Try Ollama

Experimental Concurrency Support

sudo systemctl edit ollama
Environment="OLLAMA_HOST=0.0.0.0"
Environment="OLLAMA_NUM_PARALLEL=3"
Environemnt="OLLAMA_MAX_LOADED_MODELS=3"

sudo systemctl daemon-reload
sudo systemctl restart ollama