cwchenwang/outdoor-nerf-depth

Inference model

Closed this issue · 6 comments

Hello, thank you for your good job. I want to use a trained model for rendering a small dataset and build a continuous scene. How can I do that?

Hi, thank you for reaching out. Do you mean rendering on the scenes that we used for training?

Hi, thank you for reaching out. Do you mean rendering on the scenes that we used for training?

Thank you for your reply. Yes, I have trained the ngp-depth for kitti. How can I use the trained weights to rendering on the scenes.

Hi @Augusthyq , sorry for the late reply. It is easier to use ngp-depth to render videos. Only slight modifications to the training code are required. You only need to make the following modifications to render the results. Running command is similar to training

python valid.py --root_dir $ROOT_DIR \
                --scale $SCALE \
                --mod_ratio $MOD_RATIO \
                --eval_lpips \
                --depth_loss_w $DEPTH_LOSS_WEIGHT \
                --depth_folder $DEPTH_DIR \
                --check_val_every_n_epoch 1 \
                --batch_size $BS \
                --exp_name OnlineScale_mod" \
                --val_only \
                --ckpt_path epoch29.ckpt
image

Hi @Augusthyq , sorry for the late reply. It is easier to use ngp-depth to render videos. Only slight modifications to the training code are required. You only need to make the following modifications to render the results. Running command is similar to training

python valid.py --root_dir $ROOT_DIR \
                --scale $SCALE \
                --mod_ratio $MOD_RATIO \
                --eval_lpips \
                --depth_loss_w $DEPTH_LOSS_WEIGHT \
                --depth_folder $DEPTH_DIR \
                --check_val_every_n_epoch 1 \
                --batch_size $BS \
                --exp_name OnlineScale_mod" \
                --val_only \
                --ckpt_path epoch29.ckpt
image

Thank you for your reply. I do that. But I find another question. The trained model can only validate on the same dataset which it is trained. When I try another dataset, it fails. Can the model inference a different dataset?
2

@Augusthyq Hi, I think we cannot evaluate the model on a different dataset because NeRF is a per-scene optimization method.

@Augusthyq Hi, I think we cannot evaluate the model on a different dataset because NeRF is a per-scene optimization method.

I see. Thank you very much.