hzxie/Pix2Vox

Generalizability Issues

Closed this issue · 1 comments

Hi,

I tried testing the pretrained model on a number of CAD models from the ABC dataset, but the network fails to recover the shapes, even when 5 views are used. I rendered the 2D images using Blender. I wonder if it is the method of rendering that is causing the problem, or the model just cannot generalize to unseen classes. I should also mention that the code worked fine on the customized ShapeNet dataset provided in the repo. Any thoughts? I have attached the model, reconstruction, and the rendered views down below.
Thanks

gtv
gv
04.zip

hzxie commented

At least, you need to fine-tune on the ABC dataset.
In our paper, we tested our model (pretrained on the ShapeNet dataset) on the unseen classes of the ShapeNet dataset. The gap between the classes should be much smaller.