NVIDIAGameWorks/kaolin

How to generate metadata, npy dataset

YIEGR opened this issue · 1 comments

YIEGR commented

Hello I'm new to kaolin package.
I'm interested in 3D reconstruction tasks. So I want to apply DIB-R model on my task.

I have some questions, and I already read your answer in Q#657.

  1. Can i generate metadata file with single png file?
  2. May i know How to generate metadata file in code? (I have only a single png file)
  3. what 'tf_mat' & 'asset_transforms mean?
Caenorst commented

Hi @YIEGR , the metadata are generated by the Omniverse App. I can help you generating metadata file. To answer your questions:

You said you want to use a single png file, do you want to do single image to 3D? The DIB-R tutorial is not so suitable for that task, it's more of multiviews to 3D

tf_mat is the camera transformation matrix, asset_transforms is internal USD transformation for things like normalization or internal transformation (if you have transformation between objects within the scene), most likely for you it's a identity transformation matrix.