/Video-Frame-Interpolation-Summary

Video Frame Interpolation Summary and Infer

Primary LanguagePythonApache License 2.0Apache-2.0

Video-Frame-Interpolation-Summary

Video Frame Interpolation Summary 2024
Summary2023

update

2024-01-11:新增结合ffmpeg的视频推理代码basic_infer
如有其他想测试模型或视频,可以在issue中联系
2024-01-11:新增结合推理演示视频(1080P) https://space.bilibili.com/350913028

参考网站

1.https://paperswithcode.com/sota/video-frame-interpolation-on-ucf101-1
2.https://paperswithcode.com/sota/video-frame-interpolation-on-vimeo90k
3.https://paperswithcode.com/sota/video-frame-interpolation-on-x4k1000fps
4.https://github.com/AIVFI/Video-Frame-Interpolation-Rankings-and-Video-Deblurring-Rankings
5.https://sniklaus.com/vfibench(Benchmarking Video Frame Interpolation)

List

数据集:Vimeo90K:

index method paper code PSNR SSIM Algorithm Traindata Arbitrary
1 MA-VFI(Arxiv 2402) paper code 35.96 0.980 Motion-Aware Vimeo90K True
2 VIDIM (Arxiv 2404) paper code - - generate video mixture: WebVid + . True
3 LADDER(Arxiv 2404) paper code 36.65 0.981 光流,更高效 Vimeo90K False/结构可改
4 SGM-VFI(Arxiv 2404) paper code - - large motion Vimeo90K/X4K1000FPS False/结构可改
5 MADIFF(Arxiv 2404) paper code - - a novel diffusion framework Vimeo90K -
6 PerVFI(Arxiv 2404) paper code - - 降低模糊和伪影 Vimeo90K -
7 ConsecutiveBrownianBridge(Arxiv 2405) paper code - - Brownian Bridge Vimeo90K True
8 ToonCrafter(Arxiv 2405) paper code - - 动漫插帧 - True
9 ZeroSmooth(Arxiv 2406) paper code - - Training-free Diffuser - True
10 Swin-VFI(Arxiv 2406) paper code 38.04 0.981 Swin-Transverter的多阶段多尺度网络 Vimeo90K False
11 LAVIB(Arxiv 2406) paper code - - 提出一个新的数据集 - -
12 MoMo(Arxiv 2406) paper code - - 解脱运动建模MoMo一种基于扩散的VFI方法 Vimeo90K -
13 VFI-SwinT(Arxiv 2406) paper code - - 基于Swin-Transformer Vimeo90K -
14 VFIMamba(Arxiv 2407) paper code 36.64 0.9819 基于Mamba Vimeo90K -

Dataset

UCF101: Download UCF101 dataset
Vimeo90K: Download Vimeo90K dataset
MiddleBury: Download MiddleBury OTHER dataset
HD: Download HD dataset

致谢

感谢各位大佬的开源,希望大佬们论文多多,工作顺利。如有侵犯权益,可联系我进行修改和删除。