/ProLong

Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"

Primary LanguagePythonMIT LicenseMIT

ProLong

Soon to come!