DavidNemeskey/emBERT

Use DistributedDataParallel

DavidNemeskey opened this issue · 0 comments

Under Python 3.9, I could not get the DataParallel-based training to work (version 1.2.0), so multi-GPU training has been removed from version 1.3.0. Reimplement this functionality properly with DistributedDataParallel.