Rendering training data
Closed this issue · 2 comments
Hi. Thank you for your great work and for making the preprocessed data available!
Is it possible for you to also share the code used for rendering the depth map and other attributes?
I'm currently using BlenderProc to this end, and noticed that the scenes loaded with the Front3D dataloader do not perfectly match the provided RGB images (depth, etc.). For example, in the test split the lamp in the image 000746_rgb_003821 is rotated
| Original rendered image | BlenderProc rendered scene |
|---|---|
Hello! Thank you for your interest in our work!
We also use Blenderproc to generate data.
I noticed that your question can be divided into two parts, “Why are the colors different?” and "Why are some objects rotating?".
1. Why are the colors different?
This is because the RGB image I provided is not directly rendered by us, but provided by the official rendering of the Alibaba team. The open-source 3D Front dataset does not include the textures of objects and ambient light when the Alibaba team rendered these images at the time, so the RGB images rendered using Blenderproc will be different from the original images. The RGB image we rendered is similar to the color of your object. I think your color is reasonable.
2. Why are some objects rotating?
I think you may have encountered a problem we had with rendering at the time, the Front3DLoader provided by Blenderproc had a rotation bug( in Front3DLoader.py), so I changed the source code of Blenderproc and got the correct results as follows.
(I show the depth map)
Below is my changed Front3DLoader.py code, you can replace the original code and try again.
Front3DLoader.py
The location and replacement method of the source code are as follows:
In the picture above, Front3DLoader-old.py is the source code, and Front3DLoader.py is the code after I changed it. You can do this similarly. I ensured that the interface function remains unchanged when making changes, so just replace the file directly.
I hope my answer can solve your problem!
And if it is useful to others, I will open source my data processing code after the Spring Festival.
Happy Spring Festival!
Thanks a lot, this is very helpful.
Happy Spring Festival!