/extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

Primary LanguagePythonApache License 2.0Apache-2.0

Watchers

No one’s watching this repository yet.