Code for Hyperbolic Pre-Trained Language Model (TASLP).
The code is written based on Nvidia's Deep Learning Example. You can refer to the original repo to see the guidelines on data preparation. We provide the script for pre-training hyperbolic BERT in scripts/run_bert.sh
The fine-tuning scripts are provided in scripts.
We provide the pre-trained hyperbolic BERT here, you can download and extract to results/