OptimalScale/LMFlow

Does it support llama3?

Opened this issue · 5 comments

Does it support multi-gpu raining llama3 with lisa ?

Thanks for your interest in LMFlow! We currently support single-gpu training of LLaMA-3-7b with LISA. We are working on the multi-gpu model-parallelism version, hopefully in 1-2 weeks, please stay tuned. Thanks for your understanding 😄

LLaMA-3-7b

Do you support llama 2-7b? Or llama 3-8B? llama3-7b does not exist.

Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.

Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.

Which parameter is used to configure authorized account related information?

Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.

Which parameter is used to configure authorized account related information?

You may first switch to lmflow conda env using

conda activate YOUR_ENV_NAME

then use

huggingface-cli login

and follow the instructions.