/VFIformer-WebUI

Advanced AI-Based Movie Restoration UI Using VFIformer & Real-ESRGAN

Primary LanguagePythonMIT LicenseMIT

Pylint pybadge ptbadge nvbadge

VFIformer-WebUI - AI-Based Movie Restoration

Screenshot 2023-03-06 154321

Example - Interpolated Frames
example
Example - Video Inflation (YouTube)
Demo of 32X Video Inflation with marked original frames
Example - GIF to MP4 (frame size X4, frame rate X8) Example - Original GIF
https://user-images.githubusercontent.com/825994/224549158-7df76e49-28ec-4a3c-9b2b-4699729bd84f.mp4 http_t0 tagstat com_image03_0_21c475648484948484881505552
🎥 VFIformer-WebUI Features  
➗ Frame Interpolation Restore Missing Frames, Reveal Hidden Motion
🔎 Frame Search Synthesize Between Frames At Precise Times
🎈 Video Inflation Create Super Slow-Motion
💕 Resynthesize Video Create a Complete Set of Replacement Frames
🪄 Frame Restoration Restore Adjacent Missing / Damaged Frames
🔬 Video Blender Project-Based Movie Restoration
📁 File Conversion Convert between PNG Sequences and Videos
🔢 Resequence Files Renumber for Import into Video Editing Software
🎞️ Change FPS Convert any FPS to any other FPS
💎 GIF to MP4 Convert Animated GIF to MP4 in one click
📈 Upscale Frames Use Real-ESRGAN to Enlarge and Clean Frames

Set Up For Use

  1. Get VFIformer working on your local system
  1. Clone this repo in a separate directory and copy all directories/files on top of your working VFIformer installation
  • This code makes no changes to their original code (but borrows some) and causes no conflicts with it
  • It shouldn't introduce any additional requirements over what VFIformer, Gradio-App and Real-ESRGAN need
  1. If it's set up properly, the following command should write a new file images/image1.png using default settings

python interpolate.py

Alternate Set Up / Development

  1. Get VFIformer working on your local system
  1. Clone this repo to a directory in which you intend to use the app and/or develop on it
  2. Copy the following directories from your working VFIformer installation to this directory:
  • dataloader
  • models
  • pretrained_models
  • utils
  1. If it's set up properly, the following command should write a new file images/image1.png

python interpolate.py

Real-ESRGAN Add-On Set Up

The GIF to MP4 feature uses Real-ESRGAN to clean and upscale frames

  1. Get Real-ESRGAN working on your local system
  1. Clone their repo to its own directory and follow their instructions for local setup
  2. Copy the realesrgan directory to your VFIformer-WebUI directory
  • The Real-ESRGAN 4x+ model (65MB) will automatically download on first use

FFmpeg Set Up

A few features rely on FFmpeg being available on the system path

Download FFmpeg

Starting Web UI Application

The application can be started in any of these ways:

  • webui.bat
  • python webui.py
    • Command line arguments
      • --config_path path path to alternate configuration file, default config.yaml
      • --verbose enables verbose output to the console, default False

Using Web UI

Wiki - Quick Start Guide

All Features

Wiki - Home

Command Line Tools

The core feature have command-line equivalents

Wiki - Command Line Tools

App Configuration

Wiki - App Configuration

Future Ideas

  • add Audio tools

My Public Uses of VFIformer

YouTube

Acknowledgements

Thanks! to the VFIformer folks for their amazing AI frame interpolation tool

Thans! to the Real-ESRGAN folks for their wonderful frame restoration/upscaling tool

Thanks! to the stable-diffusion-webui folks for their great UI, amazing tool, and for inspiring me to learn Gradio

Thanks to Gradio for their easy-to-use Web UI building tool and great docs

Royalty-Free Videos used for the examples