mbzuai-nlp/LaMini-LM

Training Code

vgoklani opened this issue · 2 comments

vgoklani commented

Are you planning to release the training and model files?

Thanks!

macabdul9 commented

Hi @vgoklani,

All trained models are available here: https://huggingface.co/MBZUAI. For code, currently, we are a little occupied with training and evaluating more models but one can use Standford's Alpaca to train models on LaMini Instructions as we are following the same. For more details please look into our paper: https://arxiv.org/abs/2304.14402

Thanks again.

haiduo commented

Hi @vgoklani,

All trained models are available here: https://huggingface.co/MBZUAI. For code, currently, we are a little occupied with training and evaluating more models but one can use Standford's Alpaca to train models on LaMini Instructions as we are following the same. For more details please look into our paper: https://arxiv.org/abs/2304.14402

Thanks again.

Hello, could you please provide the code for distilling the student model from the teacher model? How is sequence-level distillation done here?

  • ❤️1