Delexicalized Test Set
Closed this issue · 4 comments
AmitMY commented
The full test set including references was released a few months ago.
I think it would be beneficial for completeness sake to also delexicalize that data.
Reasoning:
- It is a better test set for testing referring expressions - for both seen and unseen entities.
- For systems who decouple the referring expressions generation from the sentence realization phase, this will make testing parts of systems simpler.
ThiagoCF05 commented
We are finishing the review of our annotation for train and development sets. Then we are going to start to annotate the test set. You may expect it for February 2019.
AmitMY commented
Thank you, those are great news!
AmitMY commented
Thanks for completing this!
ThiagoCF05 commented
Dear @AmitMY ,
As promised, the annotation of the test part of the data is already available. I am closing the issue here.
Best,