turboderp/exui

Cant point to the model dir

RecoveredApparatus opened this issue · 3 comments

image

Method:Wget
Model:Llama-2-7b-exl2

Note:I m not really sure if i should point to the safetensors or the config file

You'll want to point to the directory containing all of the model's files, including the .safetensors file(s), config.json and tokenizer.model.

is that case i l need to git clone instead of wget

You can wget the individual files, but git clone is easier, as long as you have git-lfs set up so you're actually downloading the files.

Another option is to use huggingface-cli or the huggingface_hub package. Some instructions here.