A collection of image-to-image papers.
Papers are ordered in arXiv first version submitting time (if applicable).
Feel free to send a PR or issue.
TOC
Note | Model | Paper | Conference | paper link | code link |
---|---|---|---|---|---|
pix2pix | Image-to-Image Translation with Conditional Adversarial Networks | CVPR 2017 | 1611.07004 | junyanz/pytorch-CycleGAN-and-pix2pix | |
texture guided | TextureGAN | TextureGAN: Controlling Deep Image Synthesis with Texture Patches | CVPR 2018 | 1706.02823 | janesjanes/Pytorch-TextureGAN |
Contextual GAN | Image Generation from Sketch Constraint Using Contextual GAN | ECCV 2018 | 1711.08972 | ||
pix2pix-HD | High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs | CVPR 2018 | 1711.11585 | NVIDIA/pix2pixHD | |
one-to-many | BicycleGAN | Toward Multimodal Image-to-Image Translation | NIPS 2017 | 1711.11586 | junyanz/BicycleGAN |
keypoint guided | G2-GAN | Geometry Guided Adversarial Facial Expression Synthesis | MM 2018 | 1712.03474 | |
contour2im | Smart, Sparse Contours to Represent and Edit Images | CVPR 2018 | 1712.08232 | website | |
disentangle | Cross-domain disentanglement networks | Image-to-image translation for cross-domain disentanglement | NIPS 2018 | 1805.09730 | |
gesture | GestureGAN | GestureGAN for Hand Gesture-to-Gesture Translation in the Wild | MM 2018 | 1808.04859 | Ha0Tang/GestureGAN |
video | vid2vid | Video-to-Video Synthesis | NIPS 2018 | 1808.06601 | NVIDIA/vid2vid |
video | pix2pix-HD + Temporal Smoothing + faceGAN | Everybody Dance Now | ECCVW 2018 | 1808.07371 | website |
(un)supervised | MSGAN | Mode Seeking Generative Adversarial Networks for Diverse Image Synthesis | CVPR 2019 | 1903.05628 | HelenMao/MSGAN |
semantic to image | SPADE | Semantic Image Synthesis with Spatially-Adaptive Normalization | CVPR 2019 | 1903.07291 | NVlabs/SPADE |
Edge and color domain to reconstrcut image | PI-REC | PI-REC: Progressive Image Reconstruction Network With Edge and Color Domain | 1903.10146 | youyuge34/PI-REC | |
Cross-view image translation | SelectionGAN | Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translation | CVPR 2019 | 1904.06807 | Ha0Tang/SelectionGAN |
keypoint guided | C2-GAN | Cycle In Cycle Generative Adversarial Networks for Keypoint-Guided Image Generation | MM 2019 | 1908.00999 | |
Few shot, video | Few-shot vid2vid | Few-shot Video-to-Video Synthesis | NeurIPS 2019 | 1910.12713 | NVlabs/few-shot-vid2vid |
Note | Model | Paper | Conference | paper link | code link |
---|---|---|---|---|---|
DTN | Unsupervised Cross-Domain Image Generation | ICLR 2017 | 1611.02200 | yunjey/domain-transfer-network (unofficial) | |
UNIT | Unsupervised image-to-image translation networks | NIPS 2017 | 1703.00848 | mingyuliutw/UNIT | |
DiscoGAN | Learning to Discover Cross-Domain Relations with Generative Adversarial Networks | ICML 2017 | 1703.05192 | SKTBrain/DiscoGAN | |
CycleGAN | Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks | ICCV 2017 | 1703.10593 | junyanz/pytorch-CycleGAN-and-pix2pix | |
DualGAN | DualGAN: Unsupervised Dual Learning for Image-to-Image Translation | ICCV 2017 | 1704.02510 | duxingren14/DualGAN | |
DistanceGAN | One-Sided Unsupervised Domain Mapping | NIPS 2017 | 1706.00826 | sagiebenaim/DistanceGAN | |
semi supervised | Triangle GAN | Triangle Generative Adversarial Networks | NIPS 2017 | 1709.06548 | LiqunChen0606/Triangle-GAN |
CartoonGAN | CartoonGAN: Generative Adversarial Networks for Photo Cartoonization | CVPR 2018 | thecvf | FlyingGoblin/CartoonGAN, unofficial test, unofficial pytorch | |
non-adversarial | NAM | NAM: Non-Adversarial Unsupervised Domain Mapping | ECCV 2018 | 1806.00804 | facebookresearch/nam |
SCAN | Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks | ECCV 2018 | 1807.08536 | ||
dilated conv, improve shape deform. | GANimorph | Improved Shape Deformation in Unsupervised Image to Image Translation | ECCV 2018 | 1808.04325 | brownvc/ganimorph |
video | Recycle-GAN | Recycle-GAN: Unsupervised Video Retargeting | ECCV 2018 | 1808.05174 | aayushbansal/Recycle-GAN |
OT-CycleGAN | Guiding the One-to-one Mapping in CycleGAN via Optimal Transport | AAAI 2019 | 1811.06284 | ||
Art2Real | Art2Real: Unfolding the Reality of Artworks via Semantically-Aware Image-to-Image Translation | CVPR 2019 | 1811.10666 | aimagelab/art2real | |
latent cross-consistency | CrossNet | CrossNet: Latent Cross-Consistency for Unpaired Image Translation | 1901.04530 | ||
HarmonicGAN | Harmonic Unpaired Image-to-image Translation | ICLR 2019 | 1902.09727 | ||
Person Generation | DG-Net | Joint Discriminative and Generative Learning for Person Re-identification | CVPR 2019 | 1904.07223 | NVlabs/DG-Net |
TransGaGa | TransGaGa: Geometry-Aware Unsupervised Image-to-Image Translation | CVPR 2019 | 1904.09571 | project | |
AGUIT | Attribute Guided Unpaired Image-to-Image Translation with Semi-supervised Learning | 1904.12428 | imlixinyang/AGUIT | ||
few shot | FUNIT | Few-Shot Unsupervised Image-to-Image Translation | ICCV 2019 | 1905.01723 | project, nvlabs/FUNIT |
zero shot | ZstGAN | ZstGAN: An Adversarial Approach for Unsupervised Zero-Shot Image-to-Image Translation | 1906.00184 | linjx-ustc1106/ZstGAN-PyTorch | |
Cross-Domain Cascaded Deep Feature Translation | 1906.01526 |
Note | Model | Paper | Conference | paper link | code link |
---|---|---|---|---|---|
mask | ContrastGAN | Generative Semantic Manipulation with Mask-Contrasting GAN | ECCV 2018 | 1708.00315 | |
attention | DA-GAN | DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks | CVPR 2018 | 1802.06454 | |
mask / attention | Attention-GAN | Attention-GAN for Object Transfiguration in Wild Images | ECCV 2018 | 1803.06798 | |
attention | Attention guided GAN | Unsupervised Attention-guided Image to Image Translation | NIPS 2018 | 1806.02311 | AlamiMejjati/Unsupervised-Attention-guided-Image-to-Image-Translation |
attention, one-sided | Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attention | 1806.06195 | |||
instance aware - mask | InstaGAN | Instance-aware image-to-image translation | ICLR 2019 | openreview | sangwoomo/instagan |
AttentionGAN | Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation | IJCNN 2019 | 1903.12296 | Ha0Tang/AttentionGAN | |
instance level - bbox | INIT | Towards Instance-level Image-to-Image Translation | CVPR 2019 | 1905.01744 | project |
mask guided | Mask-Guided Portrait Editing with Conditional GANs | CVPR 2019 | 1905.10346 | cientgu/Mask_Guided_Portrait_Editing | |
U-GAT-IT | U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation | 1907.10830 | taki0112/UGATIT, znxlwm/UGATIT-pytorch |
Note | Model | Paper | Conference | paper link | code link |
---|---|---|---|---|---|
IcGAN | Invertible Conditional GANs for image editing | NIPSW 2016 | 1611.06355 | Guim3/IcGAN | |
Conditional CycleGAN | Conditional CycleGAN for Attribute Guided Face Image Generation | ECCV 2018 | 1705.09966 | ||
StarGAN | StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation | CVPR 2018 | 1711.09020 | yunjey/StarGAN | |
AttGAN | AttGAN: Facial Attribute Editing by Only Changing What You Want | TIP 2019 | 1711.10678 | LynnHo/AttGAN-Tensorflow | |
ComboGAN | ComboGAN: Unrestrained Scalability for Image Domain Translation | CVPRW 2018 | 1712.06909 | AAnoosheh/ComboGAN | |
AugCGAN (Augmented CycleGAN) | Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data | ICML 2018 | 1802.10151 | aalmah/augmented_cyclegan | |
ModularGAN | Modular Generative Adversarial Networks | ECCV 2018 | 1804.03343 | ||
sparsely grouped dataset | SG-GAN | Sparsely Grouped Multi-task Generative Adversarial Networks for Facial Attribute Manipulation | MM 2018 | 1805.07509 | zhangqianhui/Sparsely-Grouped-GAN |
GANimation | GANimation: Anatomically-aware Facial Animation from a Single Image | ECCV 2018 (honorable mention) | 1807.09251 | albertpumarola/GANimation | |
SingleGAN | SingleGAN: Image-to-Image Translation by a Single-Generator Network using Multiple Generative Adversarial Learning | ACCV 2018 | 1810.04991 | Xiaoming-Yu/SingleGAN | |
SMIT | SMIT: Stochastic Multi-Label Image-to-Image Translation | ICCVW 2019 | 1812.03704 | BCV-Uniandes/SMIT | |
InjectionGAN | Toward Learning a Unified Many-to-Many Mapping for Diverse Image Translation | 1905.08766 | |||
Image-to-Image Translation with Multi-Path Consistency Regularization | IJCAI 2019 | 1905.12498 | |||
RelGAN | RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributes | ICCV 2019 | 1908.07269 | elvisyjlin/RelGAN-PyTorch, willylulu/RelGAN |
Note | Model | Paper | Conference | paper link | code link |
---|---|---|---|---|---|
XGAN | XGAN: Unsupervised Image-to-Image Translation for Many-to-Many Mappings | ICML 2018 | 1711.05139 | dataset | |
ELEGANT | ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributes | ECCV 2018 | 1803.10562 | Prinsphield/ELEGANT | |
MUNIT | Multimodal Unsupervised Image-to-Image Translation | ECCV 2018 | 1804.04732 | NVlabs/MUNIT | |
cd-GAN (Conditional DualGAN) | Conditional Image-to-Image Translation | CVPR 2018 | 1805.00251 | ||
EG-UNIT | Exemplar Guided Unsupervised Image-to-Image Translation | ICLR 2019 | 1805.11145 | ||
PairedCycleGAN | PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup | CVPR 2018 | thecvf | ||
DRIT | Diverse Image-to-Image Translation via Disentangled Representations | ECCV 2018 | 1808.00948 | HsinYingLee/DRIT | |
UFDN | A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation | NIPS 2018 | 1809.01361 | Alexander-H-Liu/UFDN | |
non-disentangle, face makeup guided | BeautyGAN | BeautyGAN: Instance-level Facial Makeup Transfer with Deep Generative Adversarial Network | MM 2018 | author | wtjiang98/BeautyGAN_pytorch |
GDWCT | Image-to-Image Translation via Group-wise Deep Whitening and Coloring Transformation | CVPR 2019 | 1812.09912 | WonwoongCho/GDWCT | |
DRIT++ | DRIT++: Diverse Image-to-Image Translation via Disentangled Representations | 1905.01270 | project, HsinYingLee/MDMM |
-
Breaking the cycle -- Colleagues are all you need. https://arxiv.org/abs/1911.10538
-
EDIT: Exemplar-Domain Aware Image-to-Image Translation. https://arxiv.org/abs/1911.10520
-
Multi-mapping Image-to-Image Translation via Learning Disentanglement. https://arxiv.org/abs/1909.07877
-
StarGAN v2: Diverse Image Synthesis for Multiple Domains. https://arxiv.org/abs/1912.01865