Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
Primary LanguageJupyter NotebookMIT LicenseMIT
No issues in this repository yet.