/Awesome-Vision-in-Rains

This repository contains representative works related to computer vision in rainy conditions.

This is a repository that contains computer vision algorithms that works in rainy conditions.

Awesome

[paper] [code] [cite=] (up till 12/20/2022)

Surveys

  • A Comprehensive Benchmark Analysis of Single Image Deraining: Current Challenges and Future Perspectives (IJCV 2021) [paper]

  • Survey on rain removal from videos or a single image (SCI China 2021) [paper]

  • Single image deraining: From model-based to data-driven and beyond (TPAMI 2020) [paper]

  • A Survey of Single Image De-raining in 2020 (Arxiv 2020) [paper]

  • Key takeways (future directions) from these surveys

    • Realistic Evaluation Metrics
    • Combine Model-driven and Data-driven (e.g., deep unroll)
    • Generalize to real-world rains (e.g., semi/unsupervised learning, domain adaptation, transfer learning)
    • Fast, small (simple), robust video deraining
    • Deraining as Task-specific preprocessing (helps high-level tasks)
    • Multi-task learning (e.g., with snow, haze)
    • Solve Over-derain, Under-derain, and residual artifacts

Models (Deraining)

ICLR 2023 (under review)

  • Selective Frequency Network for Image Restoration [OpenReview]

  • Networks are Slacking Off: Understanding Generalization Problem in Image Deraining [OpenReview]

NeurlPS 2022

  • Generative Status Estimation and Information Decoupling for Image Rain Removal

ECCV 2022

  • Rethinking Video Rain Streak Removal: A New Synthesis Model and A Deraining Network with Video Rain Prior

  • Not Just Streaks: Towards Ground Truth for Single Image Deraining

  • ART-SS: An Adaptive Rejection Technique for Semi-Supervised Restoration for Adverse Weather-Affected Images

  • Blind Image Decomposition

CVPR 2022

  • MAXIM: Multi-Axis MLP for Image Processing

  • Restormer: Efficient Transformer for High-Resolution Image Restoration

  • Towards Robust Rain Removal Against Adversarial Attacks: A Comprehensive Benchmark Analysis and Beyond

  • Dreaming To Prune Image Deraining Networks

    • Zou et al. [paper] (NO CODE) [cite=3]

  • Unsupervised Deraining: Where Contrastive Learning Meets Self-Similarity

  • Unpaired Deep Image Deraining Using Dual Contrastive Learning

    • DCDGAN [paper] (NO CODE) [cite=8]

  • Learning Multiple Adverse Weather Removal via Two-stage Knowledge Learning and Multi-contrastive Regularization: Toward a Unified Model

  • Neural Compression-Based Feature Learning for Video Restoration

    • Huang et al. [paper] (NO CODE) [cite=3]

AAAI 2022

  • Online-Updated High-Order Collaborative Networks for Single Image Deraining

  • Close the Loop: A Unified Bottom-Up and Top-Down Paradigm for Joint Image Deraining and Segmentation

    • UBCN [paper] (NO CODE) [cite=4]

TIP 2022

  • Feature-Aligned Video Raindrop Removal With Temporal Constraints
    • Yan et al. [paper] (NO CODE) [cite=1]

WACV 2022

  • Single Image Deraining Network with Rain Embedding Consistency and Layered LSTM

  • FLUID: Few-Shot Self-Supervised Image Deraining

    • Rai et al. [paper] (NO CODE)

  • SAPNet: Segmentation-Aware Progressive Network for Perceptual Contrastive Deraining

ICCV 2021

  • Unpaired Learning for Deep Image Deraining with Rain Direction Regularizer

  • Structure-Preserving Deraining with Residue Channel Prior Guidance

  • Improving De-raining Generalization via Neural Reorganization

    • NR [paper] (NO CODE) [cite=4]

  • Let’s See Clearly: Contaminant Artifact Removal for Moving Cameras

    • Li et al. [paper] (NO CODE) [cite=6]

CVPR 2021

  • Pre-Trained Image Processing Transformer

  • Self-Aligned Video Deraining With Transmission-Depth Consistency

  • Semi-Supervised Video Deraining With Dynamical Rain Generator

  • Robust Representation Learning with Feedback for Single Image Deraining

  • From Rain Generation to Rain Removal

  • Image De-raining via Continual Learning

    • IDCL [paper] (NO CODE) [cite=15]

  • Multi-Stage Progressive Image Restoration

  • Multi-Decoding Deraining Network and Quasi-Sparsity Based Training

    • MDDNet [paper] (NO CODE) [cite=11]

  • Memory Oriented Transfer Learning for Semi-Supervised Image Deraining

  • HINet: Half Instance Normalization Network for Image Restoration

AAAI 2021

  • EfficientDeRain: Learning Pixel-Wise Dilation Filtering for High-Efficiency Single-Image Deraining

  • Rain Streak Removal via Dual Graph Convolutional Network

    • DualGCN [paper] (NO CODE) [cite=43]

TIP 2021

  • Online Rain/Snow Removal From Surveillance Videos

  • Triple-Level Model Inferred Collaborative Network Architecture for Video Deraining

  • DerainCycleGAN: Rain Attentive CycleGAN for Single Image Deraining and Rainmaking

TPAMI 2021

  • Physics-based generative adversarial models for image restoration and beyond

Year==2020

  • Rethinking Image Deraining via Rain Streaks and Vapors (ECCV 2020)

  • Beyond Monocular Deraining: Stereo Image Deraining via Semantic Understanding (ECCV 2020)

    • PRRNet [paper] (NO CODE) [cite=25]

  • Wavelet-Based Dual-Branch Network for Image Demoireing (ECCV 2020)

    • WDNet [paper] (NO CODE) [cite=42]

  • Multi-Scale Progressive Fusion Network for Single Image Deraining (CVPR 2020)

  • Syn2Real Transfer Learning for Image Deraining Using Gaussian Processes (CVPR 2020)

  • Detail-recovery Image Deraining via Context Aggregation Networks (CVPR 2020)

  • All in One Bad Weather Removal Using Architectural Search (CVPR 2020)

    • AIONet [paper] (NO CODE) [cite=65]

  • Self-Learning Video Rain Streak Removal: When Cyclic Consistency Meets Temporal Correspondence (CVPR 2020)

  • A Model-driven Deep Neural Network for Single Image Rain Removal (CVPR 2020)

  • Towards scale-free rain streak removal via selfsupervised fractal band learning (AAAI 2020)

  • Conditional Variational Image Deraining (TIP 2020)

Year==2019

  • Image De-raining Using a Conditional Generative Adversarial Network (TCSVT 2019)

  • Erl-net: Entangled representation learning for single image de-raining (ICCV 2019)

    • Erl-net [paper] (NO CODE) [cite=60]

  • RainFlow: Optical Flow Under Rain Streaks and Rain Veiling Effect (ICCV 2019)

    • RainFlow [paper] (NO CODE) [cite=25]

  • Physics-Based Rendering for Improving Robustness to Rain (CVPR 2019)

    • Halder et al. [paper] (NO CODE) [cite=72]

  • HeavyRainRestorer: Integrating physics model and conditional adversarial learning (CVPR 2019)

  • Progressive image deraining networks: A better and simpler baseline (CVPR 2019)

  • Spatial attentive single-image deraining with a high quality real rain dataset (CVPR 2019)

  • Semi-supervised transfer learning for image rain removal (CVPR 2019)

  • Depth-attentional Features for Single-image Rain Removal (CVPR 2019)

  • Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Raining (CVPR 2019)

  • Frame-Consistent Recurrent Video Deraining With Dual-Level Flow (CVPR 2019)

    • Yang et al. [paper] (NO CODE) [cite=74]

  • Singe Image Rain Removal with Unpaired Information: A Differentiable Programming Perspective (AAAI 2019)

    • RR-GAN [paper] (NO CODE) [cite=45]

  • Lightweight pyramid networks for image deraining (TNNLS2019)

  • Joint rain detection and removal from a single image with contextualized deep networks (TPAMI2019)

  • Scale-free single image deraining via visibility-enhanced recurrent wavelet learning (TIP 2019)

Year == 2018

  • Attentive generative adversarial network for raindrop removal from a single image (CVPR 2018)

  • Density-aware Single Image De-raining using a Multi-stream Dense Network (CVPR 2018)

  • Learning dual convolutional neural networks for low-level vision (CVPR 2018)

  • Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos (CVPR 2018)

  • Robust Video Content Alignment and Compensation for Rain Removal in a CNN Framework (CVPR 2018)

  • Video Rain Streak Removal by Multiscale Convolutional Sparse Coding (CVPR 2018)

  • Non-locally enhanced encoder-decoder network for single image de-raining (ACMMM 2018)

  • Recurrent squeeze-and-excitation context aggregation net for single image deraining (ECCV 2018)

Year == 2017

  • A Hierarchical Approach for Rain or Snow Removing in a Single Color Image (TIP 2017)

    • Wang et al. [paper] (NO CODE) [cite=139]

  • Should We Encode Rain Streaks in Video as Deterministic or Stochastic? (ICCV 2017)

  • Joint Bi-Layer Optimization for Single-Image Rain Streak Removal (ICCV 2017)

    • JBO [paper] (NO CODE) [cite=247]

  • Deep joint rain detection and removal from a single image (CVPR2017)

  • Removing rain from single images via a deep detail network (CVPR2017)

  • Video Desnowing and Deraining Based on Matrix Decomposition (CVPR2017)

    • Ren et al. [paper] (NO CODE) [cite=146]

  • A Novel Tensor-Based Video Rain Streaks Removal Approach via Utilizing Discriminatively Intrinsic Priors (CVPR 2017)

    • FastDeRain [paper] (NO CODE) [cite=150]

  • Clearing the skies: A deep network architecture for single-image rain removal (TIP 2017)

Datasets

Metrics

  • Full-Reference

  • Non-Reference

  • Task-driven

    • mAP
    • mPA
    • mIoU

Resources