Welcome to the model recycling github. To see the best model to start from, or study the differences between finetuned models, please visit the website. Or read the paper.
Feel free to open an issue if you have any questions or suggestions.
We provide code to fuse models following this paper, which offers an advancement over just intertaining. Instead of recycling one model, one can use several. The paper also explains when is it better than intertraining and when not.
To get to the site press on this sentence.
Cite information:
@article{choshen2022start,
title={Where to start? Analyzing the potential value of intermediate models},
author={Choshen, Leshem and Venezian, Elad and Don-Yehia, Shachar and Slonim, Noam and Katz, Yoav},
journal={arXiv preprint arXiv:2211.00107},
year={2022}
}