Xharlie/DISN

different evaluation results

yigepingzi opened this issue · 1 comments

Thanks for uploading the code.
I set up the environment and downloaded the pre-trained model SDF_DISN.
Following the given config I generated the iso object for watercraft and run the test code.

min_cf:3.0742388, arg_cf view:12, avg emd:4.351789, min_emd:1.5337949, arg_em view:12
1 /home/pingzi/nvme/datasets/DISN_datasets/march_cube_objs_v1/04530566/ffffe224db39febe288b05b36358465d/isosurf.obj avg cf:34.068142, min_cf:1.9948646, arg_cf view:6, avg emd:2.78306, min_emd:1.1900781, arg_em view:6
1 /home/pingzi/nvme/datasets/DISN_datasets/march_cube_objs_v1/04530566/5fb24b87514df43a82b0247bfa21216b/isosurf.obj avg cf:14.799217, min_cf:3.808662, arg_cf view:7, avg emd:2.4966927, min_emd:1.8077142, arg_em view:18
1 /home/pingzi/nvme/datasets/DISN_datasets/march_cube_objs_v1/04530566/8605c975778dc8634c634743f56177d4/isosurf.obj avg cf:11.427704, min_cf:3.1768718, arg_cf view:6, avg emd:2.4085941, min_emd:1.7498852, arg_em view:5
1 /home/pingzi/nvme/datasets/DISN_datasets/march_cube_objs_v1/04530566/98da594a65640370c8333f6c4d99e2c8/isosurf.obj avg cf:19.673376, min_cf:10.119444, arg_cf view:13, avg emd:4.026104, min_emd:2.98802, arg_em view:13
cat_nm:watercraft, cat_id:04530566, avg_cf:19.050472438177316, avg_emd:2.8231411160461466
done!

The result CD loss is 19.0504 EMD loss is 2.823. This is very different from your paper "cd:10.87,emd:2.55"
I don't know where is wrong.
Could you help me to figure it out?

I visualized the model and it looks correct. But sometimes there are outliers. Did you run any algorithm to filter outliers?

Screenshot from 2022-03-01 17-19-50
Screenshot from 2022-03-01 17-19-59
Screenshot from 2022-03-01 17-20-34

Fixed. I found I didn't run the clean script to clean the outliers.