xrsrke/pipegoose

Checkpointing

xrsrke opened this issue · 4 comments

xrsrke commented

Save model during training.

chufanchen commented

I think I'll try to do this in this weekend. Do we follow the API with olso or do something else？

xrsrke commented

Do we follow the API with olso

We don't.

@ChufanSuki Thank you. I think I already wrote this in this link. It seems like duplication. But we need someone to convert the format to the Hugging Face format. Would you like to work on that

chufanchen commented

Sure. I’m not sure do we need convert the format to the 🤗 format since pipegoose already use 🤗 transformer.

xrsrke commented

@ChufanSuki I move the convo of pushing a parallelized model to the correspond issue. This one is duplication. Please check it here [link]. Thank you.