/style2paints

sketch + style = paints :art:

Primary LanguageJavaScriptApache License 2.0Apache-2.0

logo

Welcome to style2paints V4!

Style2paints V4 is the current best AI driven lineart colorization tool.

Different from previous end-to-end image-to-image translation methods, style2paints V4 is the first system to colorize a lineart in real-life human workflow, and the outputs are layered.

Inputs:

● Linearts
● (with or without) Human hints
● (with or without) Color style reference images
● (with or without) Light location and color

Outputs:

● Automatic color flattening without lines (solid/flat/inherent/固有色/底色 color layer)
● Automatic color flattening with black lines
● Automatic colorization without lines
● Automatic colorization with black lines
● Automatic colorization with colored lines
● Automatic rendering (separated layer)
● Automatic rendered colorization

Style2paints V4 gives you results of the current highest quality. You are able to get separated layers from our system. These layers can be directly used in your painting workflow. Different from all previous AI driven colorization tools, our results are not single 'JPG/PNG' images, and in fact, our results are 'PSD' layers.

Online APP: http://s2p.moe/

User Instruction: https://style2paints.github.io/

And we also have an official Twitter account.

Help human in their standard coloring workflow!

Most human artists are familiar with this workflow:

sketching -> color filling/flattening -> gradients/details adding -> shading

And the corresponding layers are:

lineart layers + flat color layers + gradient layers + shading layers

Style2paints V4 is designed for this standard coloring workflow! In style2paints V4, you can automatically get separated results from each step!

Examples

logo

Here we present some results in this ABCD format. Users only need to upload their sketch, select a style, and put a light source.

When the result is achieved immediately without any human color correction, we regard this result as fully automatic result. When the result needs some color correction, human can easily put some color hints on the canvas to guide the AI coloring process. In this case, we regard these results as semi-automatic results. If a result is semi-automatic, but the quantity of human color hint points is smaller than 10, we regard these results as almost automatic result. In this section, about half of the presented results are fully automatic result, and the others are all almost automatic result. Do notice that all the below results can be achieved with less than 15 clicks!

Here we provide a video to show how all below results are achieved.

The video is a pure screen record without any after modification or speed modification.

Here is the video: https://youtu.be/B6WEky9nY7Q

And all input sketches can be found here.

(Because this page is prepared before the video is recoreded, some numbers may have minor differences.)

Example #1

Begin at 11:28 in the above video.

All human local color modification: only 3 clicks.

logo

*CC-BY-NC-SA-4.0 (c) Various artist of style2paints team, 2018. This image is OK for ACM/IEEE fair use.

Example #2

Begin at 06:19 in the above video.

All human local color modification: only 2 clicks.

logo

*CC-BY-NC-SA-4.0 (c) Various artist of style2paints team, 2018. This image is OK for ACM/IEEE fair use.

Example #3

Begin at 01:40 in the above video.

All human local color modification: only 6 clicks.

logo

*CC-BY-NC-SA-4.0 (c) Various artist of style2paints team, 2018. This image is OK for ACM/IEEE fair use.

Example #4

Begin at 00:42 in the above video.

All human local color modification: NO human color modification.

logo

*CC-BY-NC-SA-4.0 (c) Various artist of style2paints team, 2018. This image is OK for ACM/IEEE fair use.

Example #5

Begin at 02:57 in the above video.

All human local color modification: NO human color modification.

logo

*CC-BY-NC-SA-4.0 (c) Various artist of style2paints team, 2018. This image is OK for ACM/IEEE fair use.

Example #6

Begin at 07:57 in the above video.

All human local color modification: 11 clicks.

logo

Example #7

Begin at 13:00 in the above video.

All human local color modification: only 6 clicks.

logo

*CC-BY-NC-4.0 (c) Henjo. Only for this presentation.

Example #8

Begin at 04:27 in the above video.

All human local color modification: only 3 clicks.

logo

Example #9

Begin at 09:46 in the above video.

All human local color modification: only 5 clicks.

logo

*CC-BY-NC-SA-4.0 (c) Various artist of style2paints team, 2018. This image is OK for ACM/IEEE fair use.

Real-life results

To validate a really effective, useful, robust, generizable and scalable system, we firmly believe that the only convincing evidence is its real-life performance form real industry, real market, and real users.

In this section, we present real-life results from twitter artists. We are sorry that we can only provide low-resolution screenshots because we do not own the copyrights of these images. These twitters can be found by searching keyword “style2paints” and “s2p.moe” on twitter. Additionally, there are also lots of results under twitter hashtag #style2paints. These results are from artists from different countries. Note that some (very minor) results contains artists' after effect decorations. Note that some of these artists did not share their original sketch inputs on twitter.

logo

logo

logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo logo

Know more about us!

Online APP: http://s2p.moe/

User Instruction: https://style2paints.github.io/

And we also have an official Twitter account.

Acknowledgement

Thanks a lot to TaiZan. This project could not be achieved without his great help.

About Copyright

We won’t claim any additional copyright of the colorized manga, but we would be delightful if you share our software with your friends.

Furthermore, if you want to use our software in large-scale commercial or industrial production or publication, e.g. manga (entity paper manga or online e-manga), magazine, book or other online/offline large-scale materials, please contact us for permission:

914847518@qq.com
Please attach following materials when e-mailing us:
The name and additional information of the commercial publication.
The quantity of pages you are willing to print.
The sample images of the black-and-white manga and the sample pages colored via our software.

With our permission, you can enjoy more professional services with our cutting-edge technologies. Please do not use our software for large-scale commercial or industrial publications without our approval.

中文社区

欢迎加入以下qq群,但是不保证一直有空位,如果你一次加群失败,可以多次尝试。

纸片协会总舵-圣辇船:184467946

Previous Publications

Style2paints V1:

ACPR 2017:

@Article{ACPR2017ZLM,
  author  = {LvMin Zhang, Yi Ji and ChunPing Liu},
  title   = {Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN},
  conference = {Asian Conference on Pattern Recognition (ACPR)},
  year    = {2017},
}

paper

Style2paints V2:

No Publications.

Style2paints V3:

TOG 2018:

@Article{ACMTOGTSC2018,
  author  = {LvMin Zhang, Chengze Li, Tien-Tsin Wong, Yi Ji and ChunPing Liu},
  title   = {Two-stage Sketch Colorization},
  journal = {ACM Transactions on Graphics},
  year    = {2018},
  volume  = {37},
  number  = {6},
  month   = nov,
  doi     = {https://doi.org/10.1145/3272127.3275090},
}

paper

Style2paints V4:

No Publications.