/fim-pretraining

Fill-in-the-Middle Pre-training of Large Language Models in pure PyTorch!

Primary LanguagePythonMIT LicenseMIT

fim-pretraining

Fill-in-the-Middle Pre-training of Large Language Models in pure PyTorch!