rishizek/tensorflow-deeplab-v3

test accuracy?

iliadsouti opened this issue · 3 comments

iliadsouti commented

Thanks for your great project. I wonder what is the test set accuracy?

rishizek commented

Hi @iliadsouti , Thanks for interesting in the repo.
I also wonder. But the test set mIoU is not easily computable because I don't have the test set grandtruth labels and probably need to submit the evaluated result to PASCAL VOC Challenge performace evaluation server. It should be similar value to the validation set and I don't feel necessity to spend time for that.

iliadsouti commented

Hi,
In tensorflow implmentation of deeplab-v2 there is around 10% performance gap in test/validation. Some images may be both present in validation/training set. Refer to this link. You will need to submit the result to test server. That's a standard cross implmentation validation.

rishizek commented

I see. OK. I'll try when I have time. Thank you for your suggestion.