An issue about generating mask

[ShaoTengLiu]

Hi, thanks for your great work.

I am wondering why only consider the foreground as a person.

As shown in the umbrella case, the umbrella is not a person, but also successfully segmented.

[gaochen315]

Hi @ShaoTengLiu,

The background_mask is only used when calculating camera poses. We do not want to extract features from the points that belong to a person, because it is highly likely that he/she is moving.

In step 6 (Obtain motion mask), we actually define a list of foreground object categories and obtain the coarse foreground mask. It is also worth noting that this coarse foreground mask is only used to initialize the 3D blending weight. Our network will learn to refine the 3D blending weight as training goes.

Hope this helps. Please let me know if there is anything else I can help with. Thanks!

[ShaoTengLiu]

Thanks for your reply! It is very clear.