/QualityScaler

QualityScaler - image/video AI upscaler app

Primary LanguagePythonMIT LicenseMIT



QualityScaler - image/video AI upscaler app


What is QualityScaler?

Qualityscaler is a Windows app powered by AI to enhance, upscale and de-noise photographs and videos.

Other AI projects.🤓

Credits.

Citations. ❤

How is made. 🛠

QualityScaler is completely written in Python, from backend to frontend. External packages are:

  • AI -> torch / onnxruntime-directml
  • GUI -> customtkinter
  • Image/video -> OpenCV / moviepy
  • Packaging -> nuitka

Make it work by yourself. 👨‍💻

Prerequisites.

Getting started.

  • First of all, you need to download the project on your PC (Green button Code > Download ZIP)
  • Extract the project directory from the .zip
  • Now you need to download the AI models (github won't let me upload them directly because they are too big)
  • In "AI-onnx" folder, there is the link to download the AI models, download the .zip and extract the files in AI-onnx directory
  • Open the project with VSCode (just Drag&Drop the project directory on VSCode)
  • Click on QualityScaler.py from left bar (VSCode will ask you to install some plugins, go ahead)
  • Now, you need to install dependencies. In VSCode there is the "Terminal" panel, click there and execute the command "pip install -r requirements"
  • Close VSCode and re-open it (this will refresh all the dependecies installed)
  • Just click on the "Play button" in the upper right corner of VSCode
  • Now the app should work

Requirements. 🤓

  • Windows 11 / Windows 10
  • RAM >= 8Gb
  • Any Directx12 compatible GPU with >= 4GB VRAM

Features.

  • Easy to use GUI
  • Images and Videos upscale
  • Multiple AI models
  • Automatic image tiling and merging to avoid gpu VRAM limitation
  • Resize image/video before AI upscaling
  • Interpolation between the original and upscaled image/video
  • Compatible images - png, jpeg, bmp, webp, tif
  • Compatible video - mp4, wemb, gif, mkv, flv, avi, mov, qt

Next steps. 🤫

  • 1.X versions
    • Switch to Pytorch-directml to support all Directx12 compatible gpu (AMD, Intel, Nvidia)
    • New GUI with Windows 11 style
    • Include audio for upscaled video
    • Optimizing video frame resize and extraction speed
    • Multi GPU support (for pc with double GPU, integrated + dedicated)
    • Python 3.10 (expecting ~10% more performance)
  • 2.X versions
    • New, completely redesigned graphical interface based on @customtkinter
    • Upscaling images and videos at once (currently it is possible to upscale images or single video)
    • Upscale multiple videos at once
    • Choose upscaled video extension
    • Interpolation between the original and upscaled image/video
    • More Interpolation levels (Low, Medium, High)
    • Show the remaining time to complete video upscaling
    • Support for SRVGGNetCompact AI architecture
    • Metadata extraction and application from original file to upscaled file (via exiftool)
    • Support for SAFMN AI architecture
  • 3.X versions
    • New AI engine powered by onnxruntime-directml (https://pypi.org/project/onnxruntime-directml/)
    • Python 3.11 (~10% performance improvements)
    • Display images/videos upscaled resolution in the GUI
    • FFMPEG 7 (latest release)
    • Video multi-threading AI upscale
    • Python 3.12
    • Video upscaling pause and restart

Some Example.

Videos

original

BSRGANx4.mp4

Images

test

ORIGINAL

Bsrgan x4

Bsrgan x4 (2)

Bsrgan x4 (3)

Bsrgan x4