The main requirements are:
- python==3.7.9
- pytorch==1.6.0
- transformers==3.2.0
- tqdm
- URTE/UYRE_D
1. Get pre-trained BERT model for PyTorch
Download bert-base-multilingual-cased which contains pytroch_model.bin, vocab.txt and config.json. Put these under ./pretrain_models.
2. Build Data
Put our preprocessed datasets under ./data.
3. Train
Just run the script in ./script by sh train.sh.
4. Evaluate
Just run the script in ./script by sh evaluate.sh.