We mainly used pytorch=1.0.1, pytorch-pretrained-bert=0.6.1, and apex=0.1(for speedup) for this project.
Please see notes.md in each subtask folder for detailed guidance.
If you have any questions, please email Xiaochuang Han at xiaochuang.han@gmail.com. Thank you!
xhan77/AdaptaBERT
Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling
Python