how to pre-train model on OntoNotes after the noisy supervised pre- training stage

[daiyulejia]

I would like to ask you how you pre-trained the model ononto with the pre-trained model after NSP

[teapot123]

Hi,

Thanks for your interest!
We load the NSP pre-trained model, and then follow the settings in the StructShot paper to do pre-training the model on the Onto notes dataset.