rangehow/NFP

In this part, you can train raw(next token prediciton) t5 by just runing train.py like:

python train.py

For reproduce our result, you should first run:

• python preprocess_v3.py
• bash /data/ruanjh/best_training_method/t5/v3/train.sh