princeton-vl/pose-hg-train

How to deal with the keypoints which out of the image size

HansonXia opened this issue · 3 comments

HansonXia commented

Hi,
in MPII dataset, some keypoints are out of the image size, or the coordinates of some points are (0, 0), how to deal with these keypoints when generate heatmaps and calculate loss?

anewell commented

If coordinates are outside of the image frame, the ground truth heatmap consists of all zeros, the same loss (mean squared error) is applied.

ethanyanjiali commented

but if it's just one or two pixels off the border, we will still have a little bit gaussian remaining for that joint right? because the gaussian patch itself is at least 7x7.

HansonXia commented

but if it's just one or two pixels off the border, we will still have a little bit gaussian remaining for that joint right? because the gaussian patch itself is at least 7x7.

My approach is to set the heatmap to 0, and do not calculate the loss