Request for answer_dict.json for test and dev

[boxin-wbx]

The answer_dict_val.jsonl is very simple and helpful for evaluating the value set of the datasets.

I am wondering if you have any plan to release the answer dict for the test set and dev set as well to simply the evaluation? Thank you!

[drogozhang]

Thanks for your interest. Unfortunately we don't plan to release the answer dict for test set in the near future. The answer dict for dev set has been uploaded in the evaluate folder.

If you want to try your model's performance on the test set, please using our evaluation server hosted on eval.ai.