About Model Evaluation

[JueXiuHuang]

Hi,
I have trained the model on ACE2005 dataset and I want to evaluate the model performance.
In Model Evaluation block, you give two script related to evaluation, which script should I choose?

If I have some sentence, how can I get the event table just like the paper shows?

Thanks!

[luyaojie]

Hi,

1. The reported performance in the paper is computed by Offset-level Evaluation.
   I selected the model using record-level Evaluation during the training stage, and recompute the final result using Offset-level Evaluation

2. The prediction of extraction can be implemented with T5ForConditionalGeneration and TreePredictParser, and I will update the repo later.

[luyaojie]

Hi, you can email me, and I will reply to you with the demo code.