/awesome-frame-interpolation

Progress on Frame interpolation and extrapolation

Progress on Frame Interpolation and Extrapolation

A curated list of recent frame-interpolation work and resources.

Contributing

Please feel free to pull requests to add papers.

Table of Contents

Category

Methods Optical-flow-based Convolution-based Synthesis-based End-to-end GAN
PBFI ✔️
FIAC ✔️ ✔️
FIASC ✔️ ✔️
VETOF ✔️ ✔️
DFN ✔️
FSCCN ✔️
ULPI
DMGVP ✔️ ✔️

Papers

Frame Interpolation

  • Phase-Based Frame Interpolation for Video (PBFI)

    • Simone Meyer, Oliver Wang, Henning Zimmer, Max Grosse and Alexander Sorkine-Hornung, CVPR 2015.
    • [Paper] [Third-party code]

  • Video Frame Interpolation via Adaptive Convolution (FIAC)

    • Simon Niklaus, Long Mai and Feng Liu, CVPR 2017.
    • [Paper] [Web]

  • Video Frame Interpolation via Adaptive Separable Convolution (FIASC)

    • Simon Niklaus, Long Mai and Feng Liu, ICCV 2017.
    • [Paper] [Code] [Web]

  • Video Enhancement with Task-Oriented Flow (VETOF)

    • Tianfan Xue, Baian Chen, Jiajun Wu, Donglai Wei and William T. Freeman, Arxiv 2017.
    • [Paper]

Frame Extrapolation

  • Dynamic filter networks (DFN)

    • Bert De Brabandere, Xu Jia, Tinne Tuytelaars and Luc Van Gool, NIPS 2016.
    • [Paper] [Code]

  • Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks (FSCCN)

    • Tianfan Xue, Jiajun Wu, Katherine L Bouman and William T Freeman, NIPS 2016
    • [Paper] [Code] [Web]

  • Unsupervised learning for physical interaction through video prediction (ULPI)

    • Chelsea Finn, Ian Goodfellow and Sergey Levine, NIPS 2016
    • [Paper]

  • Dual Motion GAN for Future-Flow Embedded Video Prediction (DMGVP)

    • Xiaodan Liang, Lisa Lee, Wei Dai and Eric P. Xing, ICCV 2017
    • [Paper]

Software