Mission- A fun project to toon portrait images.
Try your Twitter profile picture in the below colab link. Read Getting Started Yourself before trying (scroll down).
Best suited for Twitter profile pictures. Try "Portrait" photos below 550px.
Please try Model 1 before Model 2.
Model 1:
Model 2:
Hugh Jackman, actor
Robert Downey, Jr., American actor
Jennifer Lawrence, American actress
Virat Kohli, Indian cricketer
Deepika Padukone, Indian actress
Toon-Me is just a fun project, the main focus is to bring a cartoonized effect to profile pictures. Most of the profile pictures in twitter/Linkedin are portrait images as it helps with visibility, Toon-Me is well suited for images similar to profile pictures. Two models has been combined to bring the cartoonized effect, one is ArtLine https://github.com/vijishmadhavan/ArtLine and another one is Toon-Me.
Technical details of ArtLine can be found on the below link.
https://github.com/vijishmadhavan/ArtLine
-
Progressive Resizing (https://arxiv.org/abs/1710.10196),(https://arxiv.org/pdf/1707.02921.pdf). Progressive resizing takes this idea of gradually increasing the image size, In this project the image size were gradually increased and learning rates were adjusted. Thanks to fast.ai for intrdoucing me to Progressive resizing, this helps the model to generalise better as it sees many more different images.
-
Generator Loss : Perceptual Loss/Feature Loss based on VGG16. (https://arxiv.org/pdf/1603.08155.pdf).
-
No GAN
I have created a custom dataset having 300 images.
The easiest way to get started is to simply try out on Colab:
-Best suited for Twitter profile pictures. Try photos below 550px.
-Best suited for portrait photos in T-shirt/shirt (below 550px)
-Check the below given example image, poses similar to the below image are more suitable for better results.
Open colab run all the required cells, In case of doubt check this video.
https://www.youtube.com/watch?v=ULqlp6Btk2w&t=324s
Steps to Follow (Twitter/Linkedin):
1 Open your twitter profile page
2 Click on your profile picture, Let it expand.
3 Right click on the image
4 click on "copy image address".
5 Paste it on the url space provided, and run it.
This project is built around the wonderful Fast.AI library.
- fastai==1.0.61 (and its dependencies). Please dont install the higher versions
- PyTorch 1.6.0 Please don't install the higher versions
- Output depends on Artline.
- Just Face cartoonization, nothing else.
- Some poses can be difficult for the model to asses.
- Good quality photos with proper lighting is needed for good results.
- Does not work well with random backgrounds, for better results need plain background portraits.
Mail me @ vijishmadhavan@gmail.com