/Hetu-Galvatron

Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs).

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers