The Sentence Insertion based Bert (SiBert) is pretrained with the the sentence insertion task.
- Sep 6, 2019: Initial release for SiBert code.
- create_pretraining_data.py
Create the pretraining data for SiBert.
- pretrain.py
Pretrain the SiBert.
- run_finetune_cmrc201x.py
Finetune the SiBert for cmrc2018 and cmrc2019 tasks.