To run our inference, please visit our Google Colab Notebook
To replicate our results, the following order should be used:
- (Optional) Run
wiki_download.ipynb
(Note this will take a very long time (multiple days)) - Run
data-preprocessing.ipynb
(This will run without step 1.) - (Optional) Run
train-BERT.ipynb
- (Optional) Run
train-T5.ipynb
(This will need a second virtualenv since it uses a different version of 🤗Transformers) - Run
eval-BERT.ipynb
(This will run without step 3.) - Run
eval-T5.ipynb
(This will run without step 4.) - Run
metrics.ipynb
If you just want to test our models, please refer to the inference notebook on Colab.
Authored by Shirin Harandi, Ksenia Pavlina, Adam Peace, Ralf Michael Yap