/BERT-GPU

multi-gpu pre-training in one machine for BERT from scratch without horovod (Data Parallelism)

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers