panorama warping

Question

panorama warping

yaodao-x opened this issue 4 years ago · 10 comments

Hi, fnzhan:
It is mentioned in the article, when extracting crops from panorama，you apply the same image warping as in [1] to each image.
There is no open source code of [1], do you implement this method by yourself or ask the author for source code. Or you don't apply this method while training the network.
Best wishes.
[1]Learning to predict indoor illumination from a single image. In: SIGGRAPH Asia (2017)

Answer 1 · 2021-06-30T15:24:48.000Z

The warping operation is quite trivial, we try to implement it but give up soon. Later, we directly obtained the warped image from author of [1].

Answer 2 · 2021-06-30T15:30:47.000Z

OMG，you reply very quickly. Thanks a lot.

Answer 3 · 2021-07-02T02:41:12.000Z

Hi, fnzhan:
would like share the method how to choose the best regression training model?the train.py script have not the model.val?
could you like guide the process？
best wishes!

Answer 4 · 2021-07-02T02:54:10.000Z

You can divide a validation set, and compute the L1 distance between the gaussian maps reconstructed by predicted parameters and gt parameters as the validation accuracy. Then the best regression model can be selected.

Answer 5 · 2021-07-02T06:49:22.000Z

TKS very much for your helpNow,I have some problems?Please guide me!
1、train.py script produce the summary.jpg，the left is original image,Is the right predicted map? the right image is generated by the code(env_gt_pred = np.vstack((env_gt, env_pred)) ), can I understand the env_gt is gt parameters and env_pred is the predicted parameters?
However,from the predicted output image results, it feels that the predicted features are not quite right?
2、Do the angular error added the traing processing for the quantitative evaluation? would you like share the part of the code？

Answer 6 · 2021-07-02T07:08:28.000Z

TKS very much for your helpNow,I have some problems?Please guide me!
1、train.py script produce the summary.jpg，the left is original image,Is the right predicted map? the right image is generated by the code(env_gt_pred = np.vstack((env_gt, env_pred)) ), can I understand the env_gt is gt parameters and env_pred is the predicted parameters?
However,from the predicted output image results, it feels that the predicted features are not quite right?
2、Do the angular error added the traing processing for the quantitative evaluation? would you like share the part of the code？

The training process may not be successful, you can try to over-fit the model over a small set at first.
The angular error is not added to the training process. angular error can be found in this paper 'DeepLight: Learning Illumination for Unconstrained Mobile Mixed Reality'.

Answer 7 · 2021-07-02T07:54:29.000Z

help me quantitate the result?

Answer 8 · 2021-07-05T02:08:09.000Z

Hi, fnzhan:
the trained datas of the geprojector also divided as the same of regression process?

Answer 9 · 2021-12-03T07:09:05.000Z

help me quantitate the result?

Here are some expected training results:

Answer 10 · 2021-12-03T10:08:22.000Z

Hi, fnzhan: the trained datas of the geprojector also divided as the same of regression process?

Sorry for the late reply, there is too many things and deadlines. Definitely, the same dataset division for regression and generation.