/i2gpt

gpt with no js or trackers

Primary LanguageRustGNU General Public License v3.0GPL-3.0

build

i2gpt

gpt with no js or trackers

getting started

  • install rust
  • cargo run

setting up the model with ollama

  • install ollama
  • cd models
  • download the zephyr 7b-Q5 model from huggingface
  • ollama create zephyr-local -f Modelfile
  • ollama list
  • ollama run zephyr-local
  • /bye to exit cli
  • ollama serve

api test

curl -v http://localhost:11434/api/generate -d '{ "model": "zephyr-local", "prompt": "What is water made of?", "stream": false }'

start the server

RUST_LOG=debug ./i2gpt

i2p tunnel

  • embedded i2p and automatic tunnel generation
  • set the http proxy port with export I2GPT_HTTP_PROXY=xxxx
  • set the app port with I2GPT_PORT
  • default is http proxy port is 4455, app port is 3141
  • .b32.i2p destination will printed in the logs
  • see j4i2prs for more info on the embedded i2p