muelea/shapy

Evaluation script

sarkar-rohan opened this issue · 1 comments

sarkar-rohan commented

Hello,

In https://github.com/muelea/shapy/blob/master/documentation/DATA.md, you have mentioned that you have provided a script to evaluate on the HBW validation dataset. I would be greatly obliged if you could please point me to this script and provide instructions to run the script.

Also I could not find the instructions for evaluation on the HBW test set. Could you please point me to where on the website this is mentioned. Would you be releasing the ground truth shape for the test set?

muelea commented

Hi,

sorry for the delay - I just pushed the evaluation protocols. You can find the details for HBW test set evaluation here and the instructions for HBW validation set evaluation here.

We will not release the ground truth test set, but instead decided to set up a challenge and will evaluate your estimates for you.

Best wishes,
Lea