Why near camera rendering is bad?
Closed this issue · 2 comments
Congrats on your excellent work!
In Gaussian-Eye View: First-Person and Gaussian-Eye View: Object View these two videos in your project page, I'm surprised that the near-field rendering from egocentric view is so bad, given promising quality in far-field rendering. Any specific reasons for this performance degradation?
Great question!!!
There are two reasons:
-
Near plane clipping is removing some closer points so it seems like arms are “floating”.
-
(main reason) the projection from 3D Gaussians to 2D Gaussians that is used for the rasterisation is an approximation (see Zwickler 2001). This approximation breaks down with objects really close to the camera and really off to the side with wide field of view. This is mostly what you are seeing here.
I think there are some good fixes for this in the future!
For an example of the near plane clipping effect, see here: