MehmetAygun/4D-PLS

4D Evaluation with "ignore" semantic predictions

YilmazKadir opened this issue · 1 comments

YilmazKadir commented

Hi,
I know it has been quite some time since you published the code but it is also a warning for people who wants to submit to the SemanticKITTI 4D Panoptic Segmentation benchmark. If there is even 1 point that predicts "ignore", i.e. a semantic label of 0, then the evaluation script divides the IoU to 20 instead of 19 when calculating the mIoU. If you want to get correct results in the submission benchmark, you should not predict any ignore labels.

4D-PLS/utils/eval_np.py

Line 259 in 1d029ae

num_present_classes = np.count_nonzero(union)

MehmetAygun commented

Thanks for reporting this @YilmazKadir!! I added a note in the readme to warn people!

  • 👍1