wutong16/Voxurf

Train result is bad with custom data.

Opened this issue · 3 comments

I use 70 images from diff angles to train. But train result is bad.
2023-09-07 10-18-20 的屏幕截图
2023-09-07 10-18-28 的屏幕截图
2023-09-07 10-20-54 的屏幕截图
2023-09-07 10-21-11 的屏幕截图

Hi. First, please try to extract the mesh with a higher resolution like 512. The current resolution appears to be rather low, and this adjustment may yield improved results.
If the outcome remains unsatisfactory, please investigate whether there is any slight movement in the foreground object during the video capture process, which may lead to un-consistency under the assumption of a static scene.
Further more, it seems that the case is run under the without-mask setting, please also try the with-mask setting and see if the result gets better.

Thanks for your reply.
First. My resolution config is 128. I will change it.
Next. I have got /image_rmbg and /mask. I train with "bash single_runner.sh ./configs/custom_e2e data /voxurf", but it seems not without mask. could you tell me how can i use mask?

Yes, this should have already been executed with the 'wmask' setting. The current PSNR, even for the background, appears to be quite low. I'm uncertain whether this is attributed to noise in the SFM camera pose estimation. BTW, have you observed any improvement in the mesh quality when extracting it at a resolution of 512?