zju3dv/mvpose

Test with Human3.6M

Closed this issue · 2 comments

Hi,

I am just wondering if anyone has ever tried the model using the Human3.6M dataset. I gave it a go using the Human3.6M's data and intrinsic/extrinsic parameters, but the results were not good. It sometimes reconstructed the 3D subject from two cameras but not from the other two (Figure 1~3 below). And sometimes it just assumed there were 4 persons from 4 cameras and thus no 3D reconstruction at all (Figure 4, 5 below).

I guess it was because the intrinsic/extrinsic parameters were not properly set? But it seems the projected 3D model aligns well with the unrecognized image (e.g. the 1st and 3rd images on the last row of Figure 2 below), which means that the intrinsic/extrinsic parameters were correct? Any suggestion to improve the result is much appreciated! Thanks!

Figure 1
Figure_1
Figure 2
Figure_2
Figure 3
Figure_3

Figure 4
Figure_4
Figure 5
Figure_5

Hi,
Since the geometric affinity matrix is computed using normalized values, it will have some problems if there is only one person. It can be solved by using no normalization or adding some noise. You can have a try.

@DongJT1996
I see. Much appreciated!