Is that possible to use 3 inputs to your model instead of 2 ?

Question

Is that possible to use 3 inputs to your model instead of 2 ?

Laihu08 opened this issue 3 years ago · 3 comments

Hi, I am wondering to use 3 inputs like as if now you are using 2 inputs like Sparse depth map and corresponding RGB, Is that possible to use one more input like Coarse dense depth map got from hand crafted methods with corresponding to sparse depth map ? please let me know if its possible, Thanks in advance .

Answer 1 · 2021-09-02T10:51:10.000Z

HI! Of course you could make an attempt. In our two-branch (actually hourglass-styled) backbone, the second (DD) branch could be regarded as a reprocessing procedure of the first (CD) branch prediction, which is actually a coarse predicted depth. Therefore, you could either feed the hand-crafted one into the second branch or even add a new third branch. And the third branch would function similarly as the second branch.

Answer 2 · 2021-09-02T13:58:29.000Z

Thank you so much, I will give a try as you suggested.

Answer 3 · 2021-09-07T04:18:54.000Z

Hi, @JUGGHM , sorry to ask you this question again, I want to back project the predicted depth map to point cloud coordinates, is that possible ? if so, can you give me code for back projection like input will be predicted depth map and output will be point cloud which will be denser in front view. Thank you.