Incomplete coloring with larger --mindim values.

Question

Incomplete coloring with larger --mindim values.

Opened this issue 3 years ago · 10 comments

I've run couple times into the situation where the coloring is perfect if mindim is less than 450, but with larger values the colorization will fade and the output is with pale colors which are very far from reference images. Tested this with two environments, one with Nvidia Tesla k40 with 11 GB ram and pytorch 1.2.0 (the last version compatible with oldish Tesla card).
Other with Nvidia Quadro P5000 with 16 GB ram and pytorch 1.8.1. The source video and the reference pics are 576p and the only thing I am changing is the mindim value.

Answer 1 · 2022-05-01T11:44:22.000Z

Here are sample videos of the problem - same source and same reference pictures:

https://youtu.be/Qfq6L0l4dk8 --mindim 540

https://youtu.be/OjyTnmFb_PY --mindim 320

The red color is the always the first to disappear and fade.

Answer 2 · 2023-02-25T17:15:09.000Z

@kepppis Have you managed to solve this? It's a shame it seems the authors lost insterest in this project.

Answer 3 · 2023-02-28T13:50:58.000Z

Unfortunately not, but I've found a way to get pretty similar results to highres coloring. I do the coloring on lower resolution and overlay it over the highres bw image using suitable color blending filters.

Answer 4 · 2023-02-28T19:14:10.000Z

@kepppis Yeah, that's a classic trick. =) Unfortunately the "color mask" is still too blurry to my taste, color details are lost {eyes, lips, etc.} and colors are bleeding.

I wondered if it would be possible to force a higher working resolution and maybe retrain the model but I guess I'll start from a different place.

Answer 5 · 2023-03-28T22:22:01.000Z

Let me know if you find anything usable.

Answer 6 · 2023-03-29T18:05:06.000Z

Well, I tried EbSynth for that and I use my own tool Tinterr (eriador.condak.cz/tools.php), but to get a decent result you have to feed it with a LOT of keyframes...

Answer 7 · 2023-03-29T18:16:38.000Z

My test result (about 1560 frames and 23 key frames) can be seen here:
https://www.youtube.com/watch?v=D9bcxx4xL00

None of this methods is perfect...

Answer 8 · 2024-01-05T15:48:03.000Z

Is it possible to have instructions how to use PNG-Tinterr ?

Answer 9 · 2024-01-06T12:30:55.000Z

Is it possible to have instructions how to use PNG-Tinterr ?

Yes, but I have to create a provisional English manual first... I should have created it a long time ago. =]

Answer 10 · 2024-01-06T14:12:48.000Z

@kepppis Well, here is something that might help you:
http://eriador.condak.cz/tools/png-tinterr-manual-eng.htm