/PaddleGAN

PaddlePaddle GAN library, including lots of interesting applications like First-Order motion transfer, wav2lip, picture repair, image editing, photo2cartoon, image style transfer, and so on.

Primary LanguagePythonApache License 2.0Apache-2.0

English | 简体中文

PaddleGAN

PaddleGAN provides developers with high-performance implementation of classic and SOTA Generative Adversarial Networks, and supports developers to quickly build, train and deploy GANs for academic, entertainment and industrial usage.

GAN-Generative Adversarial Network, was praised by "the Father of Convolutional Networks" Yann LeCun (Yang Likun) as [One of the most interesting ideas in the field of computer science in the past decade]. It's the one research area in deep learning that AI researchers are most concerned about.

Licensepython version

🎪 Hot Activities

🚀 Recent Updates

Document Tutorial

Installation

Starter Tutorial

Model Tutorial

Composite Application

Online Tutorial

You can run those projects in the AI Studio to learn how to use the models above:

Online Tutorial link
Motion Driving-multi-personal "Mai-ha-hi" Click and Try
Restore the video of Beijing hundreds years ago Click and Try
Motion Driving-When "Su Daqiang" sings "unravel" Click and Try

Examples

Face Morphing

Image Translation

Old video restore

Motion driving

Super resolution

Makeup shifter

Face cartoonization

Realistic face cartoonization

Photo animation

Lip-syncing

Changelog

  • v2.1.0 (2021.12.8)

    • Release a video super-resolution model PP-MSVSR and multiple pre-training weights
    • Release several SOTA video super-resolution models and their pre-trained models such as BasicVSR, IconVSR and BasicVSR++
    • Release the light-weight motion-driven model(Volume compression: 229M->10.1M), and optimized the fusion effect
    • Release high-resolution FOMM and Wav2Lip pre-trained models
    • Release several interesting applications based on StyleGANv2, such as face inversion, face fusion and face editing
    • Released Baidu’s self-developed and effective style transfer model LapStyle and its interesting applications, and launched the official website experience page
    • Release a light-weight image super-resolution model PAN

  • v2.0.0 (2021.6.2)

  • v2.0.0-beta (2021.3.1)

    • Completely switch the API of Paddle 2.0.0 version.
    • Release of super-resolution models: ESRGAN, RealSR, LESRCNN, DRN, etc.
    • Release lip migration model: Wav2Lip
    • Release anime model of Street View: AnimeGANv2
    • Release face animation model: U-GAT-IT, Photo2Cartoon
    • Release SOTA generation model: StyleGAN2

  • v0.1.0 (2020.11.02)

    • Release first version, supported models include Pixel2Pixel, CycleGAN, PSGAN. Supported applications include video frame interpolation, super resolution, colorize images and videos, image animation.
    • Modular design and friendly interface.

Community

Scan OR Code below to join [PaddleGAN QQ Group：1058398620], you can get offical technical support here and communicate with other developers/friends. Look forward to your participation!

PaddleGAN Special Interest Group（SIG）

It was first proposed and used by ACM（Association for Computing Machinery) in 1961. Top International open source organizations including Kubernates all adopt the form of SIGs, so that members with the same specific interests can share, learn knowledge and develop projects. These members do not need to be in the same country/region or the same organization, as long as they are like-minded, they can all study, work, and play together with the same goals~

PaddleGAN SIG is such a developer organization that brings together people who interested in GAN. There are frontline developers of PaddlePaddle, senior engineers from the world's top 500, and students from top universities at home and abroad.

We are continuing to recruit developers interested and capable to join us building this project and explore more useful and interesting applications together.

SIG contributions:

  • zhen8838: contributed to AnimeGANv2.
  • Jay9z: contributed to DCGAN and updated install docs, etc.
  • HighCWu: contributed to c-DCGAN and WGAN. Support to use paddle.vision.datasets.
  • hao-qiang & minivision-ai : contributed to the photo2cartoon project.

Contributing

Contributions and suggestions are highly welcomed. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring. When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA. Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA. For more, please reference contribution guidelines.

License

PaddleGAN is released under the Apache 2.0 license.