VITA-Group/FSGS

Quality issues

MrNeRF opened this issue · 5 comments

Hi,
thank you for your code and the paper.
I got it running although it has some bugs where it crashed. I can upstream the fixes later today.
Unfortunately, the quality of the output is very bad. Not sure if there are more substantial bugs in the code. I have been running it following your instructions.

Thank you.
MrNeRF

Screenshot from 2023-12-13 11-20-24
Screenshot from 2023-12-13 11-16-32

Hi, thanks for your interest in our work. What is your PSNR and LPIPS for this scene?

Actually, we are still tuning settinigs on MiP-NeRF 360 dataset. We plan to release the updated version either this week or the next.

Ok, great. I did not run it again as it takes quite long. So I don't remember theses measures. But overall the rendering output was low quality. I will rerun it when you update the code and report the measures. I am curious how it turns out.

@zehaozhu
I ran this on the bonsai scene and PSNR rises to 29 by 2k iters and then drops to 20 after iteration 2000 when the pseudo depth kicks in. visually I'm seeing similar artifacts to what's happening in MrNeRFs

Hi @MrNeRF @dlazares

The issue arises from the high weight of the pseudo depth loss applied after 2000 iterations. You can try the new version of code and use the commands for training (need to recompile the simple-knn submodule)

Thank you.
Zehao