CVPR 2019 Paper | Project Page | YouTube | BibeTex
The code has been tested on pytorch=0.4.0 and python3.6. Please refer to requirements.txt for detailed information.
To Install python packages
pip install -r requirements.txt
To Install flownet2 modules
bash install_scripts.sh
There exist three components in this repo:
- Video Inpainting Tool: DFVI
- Extract Flow: FlowNet2(modified by Nvidia official version)
- Image Inpainting(reimplemented from Deepfillv1)
- To use our video inpainting tool for object removing, we recommend that the frames should be put into
xxx/video_name/framesand the mask of each frame should be put intoxxx/video_name/masks. And please download the resources of the demo and model weights from here. An example demo containing frames and masks has been put into the demo and running the following command will get the result:
python tools/video_inpaint.py --frame_dir ./demo/frames --MASK_ROOT ./demo/masks --img_size 512 832 --FlowNet2 --DFC --ResNet101 --Propagation
We provide the original model weight used in our movie demo which use ResNet101 as backbone and other related weights pls download from here. Please refer to tools for detailed use and training settings.
- To extract flow for videos:
python tools/infer_flownet2.py --frame_dir xxx/video_name/frames
- To use the Deepfillv1-Pytorch model for image inpainting,
python tools/frame_inpaint.py --test_img xxx.png --test_mask xxx.png --image_shape 512 512
- Errors when running install_scripts.sh if you meet some problem about gcc when compiling, pls check if the following commands will help:
export CXXFLAGS="-std=c++11"
export CFLAGS="-std=c99"
@InProceedings{Xu_2019_CVPR,
author = {Xu, Rui and Li, Xiaoxiao and Zhou, Bolei and Loy, Chen Change},
title = {Deep Flow-Guided Video Inpainting},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2019}
}