Question about benchmark.py (Index Error & Mean)

Thanks for sharing good work.
I have some simple question about your implementation.

Q1. Some object meta data and pose gt not correctly matched in the dataset.
I think that the problem comes from the difference between meta data and pose label.
For example,
"nocs/real_test/scene_1/0203_color.png" there are only have 4 class, but in the "meta.txt", they have 5 class.
And in the "My_NOCS/data/gts/real_test/results_real_test_scene_1_0203.pkl", they only have 4 pose labels.
Can I ask how to handle this part??

6-PACK/benchmark.py

Line 200 in a28e96a

gt_pose = result['gt_RTs'][num_idx]

Q2. What's difference between 5cm 5degree and Mean 5cm 5degree ??
Does Mean 5cm 5degree was used for 5 times evaluation??
And could you explain detailed whether mAP or not??, I'm still confused what is different.
#15 (comment)

6-PACK/benchmark.py

Line 256 in a28e96a

print("Mean 5cm 5degree:",np.mean(np.array(all_score)*100,0)[-1])

[Terminal Output]


**bowl_white_small_norm**
index error 4     My_NOCS/data/gts/real_test/results_real_test_scene_1_0203.pkl
index error 4     My_NOCS/data/gts/real_test/results_real_test_scene_1_0204.pkl
**camera_canon_len_norm**
index error 4     My_NOCS/data/gts/real_test/results_real_test_scene_1_0198.pkl
index error 4     My_NOCS/data/gts/real_test/results_real_test_scene_1_0199.pkl
**mug_daniel_norm**
index error 4     My_NOCS/data/gts/real_test/results_real_test_scene_1_0200.pkl
index error 4     My_NOCS/data/gts/real_test/results_real_test_scene_1_0201.pkl
index error 4     My_NOCS/data/gts/real_test/results_real_test_scene_1_0202.pkl

********************************************************
5cm 5degree: 31.86850232958812
IoU 25:      96.40904934750537
IoU 50:      73.21566899557062
rot error:   18.560087960402228
tran error:  3.4760268421587646
********************************************************
Mean 5cm 5degree: 31.86850232958812
Mean IoU 25:      96.40904934750537
Mean IoU 50:      73.21566899557062
Mean rot error:   18.560087960402228
Mean tran error:  3.4760268421587646
********************************************************

I solved first question.

hughw19/NOCS_CVPR2019#21
#16