Question about benchmark.py (Index Error & Mean)
Closed this issue · 1 comments
Thanks for sharing good work.
I have some simple question about your implementation.
Q1. Some object meta data and pose gt not correctly matched in the dataset.
I think that the problem comes from the difference between meta data and pose label.
For example,
"nocs/real_test/scene_1/0203_color.png" there are only have 4 class, but in the "meta.txt", they have 5 class.
And in the "My_NOCS/data/gts/real_test/results_real_test_scene_1_0203.pkl", they only have 4 pose labels.
Can I ask how to handle this part??
Line 200 in a28e96a
Q2. What's difference between 5cm 5degree and Mean 5cm 5degree ??
Does Mean 5cm
5degree was used for 5 times evaluation??
And could you explain detailed whether mAP or not??, I'm still confused what is different.
#15 (comment)
Line 256 in a28e96a
[Terminal Output]
**bowl_white_small_norm**
index error 4 My_NOCS/data/gts/real_test/results_real_test_scene_1_0203.pkl
index error 4 My_NOCS/data/gts/real_test/results_real_test_scene_1_0204.pkl
**camera_canon_len_norm**
index error 4 My_NOCS/data/gts/real_test/results_real_test_scene_1_0198.pkl
index error 4 My_NOCS/data/gts/real_test/results_real_test_scene_1_0199.pkl
**mug_daniel_norm**
index error 4 My_NOCS/data/gts/real_test/results_real_test_scene_1_0200.pkl
index error 4 My_NOCS/data/gts/real_test/results_real_test_scene_1_0201.pkl
index error 4 My_NOCS/data/gts/real_test/results_real_test_scene_1_0202.pkl
********************************************************
5cm 5degree: 31.86850232958812
IoU 25: 96.40904934750537
IoU 50: 73.21566899557062
rot error: 18.560087960402228
tran error: 3.4760268421587646
********************************************************
Mean 5cm 5degree: 31.86850232958812
Mean IoU 25: 96.40904934750537
Mean IoU 50: 73.21566899557062
Mean rot error: 18.560087960402228
Mean tran error: 3.4760268421587646
********************************************************
I solved first question.