Does it support llama3?
Opened this issue · 5 comments
Does it support multi-gpu raining llama3 with lisa ?
Thanks for your interest in LMFlow! We currently support single-gpu training of LLaMA-3-7b with LISA. We are working on the multi-gpu model-parallelism version, hopefully in 1-2 weeks, please stay tuned. Thanks for your understanding 😄
LLaMA-3-7b
Do you support llama 2-7b? Or llama 3-8B? llama3-7b does not exist.
Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.
Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.
Which parameter is used to configure authorized account related information?
Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.
Which parameter is used to configure authorized account related information?
You may first switch to lmflow conda env using
conda activate YOUR_ENV_NAME
then use
huggingface-cli login
and follow the instructions.