OptimalScale/LMFlow

Support Mistral 7B model

wenlinyao opened this issue · 3 comments

Do you have the plan to support Mistral 7B model since it outperforms both LLaMA-1 and LLaMA-2? (https://mistral.ai/news/announcing-mistral-7b/)
Thanks!

Hi,
Thanks for your attention! Mistral is indeed a better model given their reported results.
If you want to use it, you can simply change the model_name_or_path to the name of the checkpoint. For example, mistralai/Mistral-7B-v0.1.
If you have any questions, feel free to let me know~