vicuna-tools/vicuna-installation-guide

General Question

Proper231 opened this issue · 2 comments

I know other Vicuna installs require you to get the llama weight in order to run vicuna, is that also the case for this installation?

No, you don't need to have the llama weights for this install.
This guide uses the full vicuna weights, instead of only the deltas.
Normally you need to merge the vicuna deltas with the llama weights, but thanks to a user on HF(HuggingFace) who has already merged it, we can use the full vicuna weights.

ahhh ok, thank you for the clarification