A set of scripts and configurations for pretraining of Large Language Models (LLM)
Primary LanguagePythonMIT LicenseMIT