city-super/MatrixCity

Inquiry about aerial_street_fusion

oungji212 opened this issue · 2 comments

Thank you very much for your valuable work!

According to the discussion in issue #30, the ply file for 'aerial_street_fusion' is indicated to be 'Block_small.ply' in the 'small_city_pointcloud/merge' directory.
I am attempting to train 3DGS and Octree-GS using the pose(json) and images from 'aerial_street_fusion', alongside 'Block_small.ply'.

However, when rendering using the 'readCamerasFromTransforms' function from Octree-GS (link to function), the rendered images appear empty, with nothing being displayed.

Could you please provide some code or guidance on how to properly initialize 3DGS/Octree-GS with the provided ply file, while using the 'transforms.json' from 'aerial_street_fusion' for training?

Thank you!

Well, there's nothing different between matrixcity and other datasets. Load ply using #L120 and load json using #L204.
If you have more questions, please feel free to let me know and show some visualized results.

After several attempts, I found that changing the existing code:

c2w = np.array(frame["transform_matrix"])
c2w[:3, 1:3] *= -1

to the following:

c2w = np.array(frame["transform_matrix"])
c2w[:3, :] /= 100
c2w[:3, 1:3] *= -1

resolved the issue. Thank you for your reply!