Questions about SIBR_viewers browser display and source code

Question

Questions about SIBR_viewers browser display and source code

xdw-123 opened this issue 5 months ago · 16 comments

Thanks to the author, I encountered two problems:
One is to download your public exe execution program, where the -s and -m parameters point to that path specifically. What I understand is that -s points to the colmap generated folder, and -m is the model generated by output. The picture below is what I ran. As a result, the model cannot be viewed

Second, when compiling the source code of SIBR_viewers, it was found that the CudaRasterizer::Rasterizer::visible_filter function did not seem to be uploaded to the public.

Answer 1 · 2024-04-16T07:35:12.000Z

tongji-rkr commented 5 months ago

Answer 2 · 2024-04-16T07:45:38.000Z

Thank you for your reply. I found that there seems to be no color_mlp.pt, cov_mlp.pt, embedding_appearance.pt, and opacity_mlp.pt files in the generated model. I ran train_db.sh directly and downloaded the test data sets drjohnson and playroom. Are there any missing steps? Will the function mentioned above be made public?

Answer 3 · 2024-04-16T07:46:18.000Z

We fix the second problem you raised. you can replace diff-gaussian-rasterization with https://github.com/tongji-rkr/diff-gaussian-rasterization

Answer 4 · 2024-04-16T07:49:01.000Z

tongji-rkr commented 5 months ago

Answer 5 · 2024-04-16T07:51:23.000Z

if you set appearance_dim>0, embedding_appearance.pt will appear.

Answer 6 · 2024-04-16T08:01:08.000Z

Thank you for your reply. What parameters need to be modified for these files to come out?

Answer 7 · 2024-04-16T08:03:15.000Z

This is the default result.
Did these documents not appear after your training? Could you give me a screenshot.

Answer 8 · 2024-04-16T08:05:46.000Z

xdw-123 commented 5 months ago

Answer 9 · 2024-04-16T08:08:34.000Z

I was also quite puzzled after seeing your screenshot of the operation.

Answer 10 · 2024-04-16T08:08:43.000Z

Your training is fine, you can find the required files in point_cloud/iteration_40000.
But I'm not sure if viewers will work on Linux, since I compiled it on Win11.

Answer 11 · 2024-04-16T08:09:48.000Z

You need to move the files to get the structure shown above.

Answer 12 · 2024-04-16T08:22:10.000Z

Thank you for your reply. I will move the file according to your idea. The execution file still cannot be displayed.

Answer 13 · 2024-04-16T08:28:52.000Z

Please create a new directory and paste the content you want into it according to this structure

Answer 14 · 2024-04-16T08:34:12.000Z

This may be a legacy issue for Scaffold–GS viewers, which I will resolve as soon as possible.

Answer 15 · 2024-04-16T08:37:50.000Z

Thank you for your reply. It is indeed necessary to create a new document and reposition the file. I now see the model.

Answer 16 · 2024-04-17T05:19:19.000Z

We update the viewers. The latest viewer can directly rendering without changing the file structure.