$ git clone https://github.com/MSWon/Context-Char-Transformer-Encoder.git
$ cd Context-Char-Transformer-Encoder
$ pip install -r requirements.txt
$ python setup.py install
- Download 1-billion-word benchmark data
- Pretrain using config.yaml file
$ cd CCTE
$ python main.py -c config.yaml
- Download pretrained model
$ cd CCTE
$ sh download_model.sh
- Fine-tune with ner_config.yaml file on dev data
$ python ner_train.py -c ner_config.yaml
- Infer on test data
$ python ner_infer.py -c ner_config.yaml -i CoNLL/test_org.txt