| description |
|---|
Deep learning papers notes sharing, especially for image forgery detection and localization |
Newly added papers will be organized at the top of every category now.
- Datasets Resources
- Nice Expression
- Research Methods (public information summery)
- Paper Resource Links
骨干网络，多为图像分类的网络。
- Attention Is All You Need (NeurIPS '17) [Paper] [Code_official] [Code_community]
- EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks (ICML '19) [Paper] [Code]
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (ICLR '21) [Paper] [Code]
- Multi-Dimensional Model Compression of Vision Transformer (ICME '22) [Paper]
- Deep Residual Learning for Image Recognition (CVPR '16) [Paper]
- Generative Adversarial Networks (NeurIPS '14) [Paper]
- Masked Auto-Encoders Meet Generative Adversarial Networks and Beyond (CVPR '23) [Paper]
- A Kernel Perspective of Skip Connections in Convolutional Networks (ICLR '23) [Paper]
- EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention (CVPR '23) [Paper] [Code] [Note_community]
图像篡改检测定位
2023 This year
- Evading Detection Actively: Toward Anti-Forensics against Forgery Localization (arXiv '23) [Paper] [Code]
- Multi-scale attention context-aware network for detection and localization of image splicing: Efficient and robust identification network (Appl. Intell. 23') [Paper]
- ReLoc: A Restoration-Assisted Framework for Robust Image Tampering Localization (TIFS '23) [Paper] [Code]
- Image manipulation detection by multiple tampering traces and edge artifact enhancement (PR '23) [Paper] (EMT-Net)
- CFL-Net: Image Forgery Localization Using Contrastive Learning (WACV '23) [Paper] [Code]
- TruFor: Leveraging all-round clues for trustworthy image forgery detection and localization (CVPR '23) [Paper] [Project] [Code]
- TBFormer: Two-Branch Transformer for Image Forgery Localization (SPL '23) [Paper] [Code]
- Detecting and Grounding Multi-Modal Media Manipulation (CVPR '23) [Paper] [Code] [Project]
- Hierarchical Fine-Grained Image Forgery Detection and Localization (CVPR '23) [Paper] [Code]
- Edge-aware Regional Message Passing Controller for Image Forgery Localization (CVPR '23) [Paper] [Video]
- AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensics (CVPRW '23) [Paper] [Dataset]
- CTP-Net: Character Texture Perception Network for Document Image Forgery Localization (arXiv '23) [Paper]
- IML-ViT: Image Manipulation Localization by Vision Transformer (arXiv '23) [Paper] [Code]
- TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localization (ICCV '23) [Paper] [Code]
- Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learning (ICCV '23) [Paper] [Code]
- Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learning (ICCV '23) [Paper] [Code] [ResearchGate]
- SAFL-Net: Semantic-Agnostic Feature Learning Network with Auxiliary Plugins for Image Manipulation Detection (ICCV '23) [Paper]
- Uncertainty-guided Learning for Improving Image Manipulation Detection (ICCV '23) [Paper]
- Controllable Guide-Space for Generalizable Face Forgery Detection (ICCV '23) [Paper]
- Rethinking Image Forgery Detection via Contrastive Learning and Unsupervised Clustering (arXiv '23) [Paper] [Code]
- Pixel-Inconsistency Modeling for Image Manipulation Localization (arXiv '23) [Paper]
- Perceptual MAE for Image Manipulation Localization: A High-level Vision Learner Focusing on Low-level Features (arXiv '23) [Paper]
- On the Security of the One-and-a-Half-Class Classifier for SPAM Feature-Based Image Forensics (TIFS '23) (Traditional method, Analysis) [Paper]
2022
- MSMG-Net: Multi-scale Multi-grained Supervised Metworks for Multi-task Image Manipulation Detection and Localization (ArXiv '22) [Paper]
- Towards JPEG-Resistant Image Forgery Detection and Localization Via Self-Supervised Domain Adaptation (TPAMI '22) [Paper]
- ESRNet: Efficient Search and Recognition Network for Image Manipulation Detection (TOMCCAP '22) [Paper] [Tool]
- Learning to localize image forgery using end-to-end attention network (Neurocomputing '22) [Paper] [Code]
- MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection (TPAMI '22) [Paper] [Code]
- Robust Image Forgery Detection Over Online Social Network Shared Images (CVPR '22) [Paper] [Code]
- ObjectFormer for Image Manipulation Detection and Localization (CVPR '22) [Paper]
- GCA-Net: Utilizing Gated Context Attention for Improving Image Forgery Localization and Detection (CVPRW '22) [Paper]
- Non-Semantic Evaluation of Image Forensics Tools: Methodology and Database (WACV '22) [Paper] [Code]
- JPEG Compression-aware Image Forgery Localization (MM '22) [Paper]
- Image Manipulation Localization Using Multi-Scale Feature Fusion and Adaptive Edge Supervision (TMM '22) [Paper]
- PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localization (TCSVT '22) [Paper] [Code]
- Self-Adversarial Training incorporating Forgery Attention for Image Forgery Localization (TIFS '22) [Paper] [Code] (LocateNet / SATFL)
- M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection (ICMR '22) [Paper] [Code]
- A Principled Design of Image Representation: Towards Forensic Tasks (TPAMI '22) [Paper] [Code]
- TBNet: A Two-stream Boundary-aware Network for Generic Image Manipulation Localization (KDE '22) [Paper]
- Learning JPEG Compression Artifacts for Image Manipulation Detection and Localization (IJCV '22) [Paper] [Code]
- Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection (arXiv '22) (Survey) [Paper]
2021
- MSTA-Net: Forgery Detection by Generating Manipulation Trace Based on Multi-Scale Self-Texture Attention (TCSVT '21) [Paper]
- Image Manipulation Detection by Multi-View Multi-Scale Supervision (ICCV '21) [Paper] [Code]
- TransForensics: Image Forgery Localization with Dense Self-Attention (ICCV '21) [Paper]
- Self-supervised Domain Adaptation for Forgery Localization of JPEG Compressed Images (ICCV '21) [Paper]
- Image Tampering Localization Using a Dense Fully Convolutional Network (TIFS '21) [Paper] [Code] (DenseFCN)
- Image Manipulation Localization Using Attentional Cross-Domain CNN Features (TNNLS '21) [Paper]
2020 and before
- A Full-Image Full-Resolution End-to-EndTrainable CNN Framework for Image Forgery Detection (IEEE Access '20) **[Paper]
- Constrained R-CNN: A general image manipulation detection model (ICME '20) [Paper] [Code]
- A CNNBased Camera Model Fingerprint (TIFS '20) **[Paper]
- An Adaptive Neural Network for Unsupervised Mosaic Consistency Analysis in Image Forensics (CVPR '20) [Paper] [Code]
- A dense u-net with cross-layer intersection for detection and localization of image forgery (ICASSP '20) [Paper] [Note_unofficial]
- Generate, Segment, and Refine: Towards Generic Manipulation Segmentation (AAAI '20) [Paper] [Code] (GSRNet)
- SPAN: Spatial Pyramid Attention Network for Image Manipulation Localization (ECCV '20) [Paper] [Project] [Code]
- Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeries (TIP '19) [Paper] [Code]
- ManTra-Net: Manipulation Tracing Network for Detection and Localization of Image Forgeries With Anomalous Features (CVPR '19) [Paper] [Code]
Some of the above papers also contain methods to detect tampered images generated by GANs or DMs for synthetic images
- MaLP: Manipulation Localization Using a Proactive Scheme (CVPR '23) [Paper] [Code]
- Discrepancy-Guided Reconstruction Learning for Image Forgery Detection (IJCAI '23) [Paper] [Code]
- Generalizable Synthetic Image Detection via Language-guided Contrastive Learning (ArXiv '23) [Paper] [Code]
- Detect Any Deepfakes: Segment Anything Meets Face Forgery Detection and Localization (ArXiv '23) [Paper] [Code]
- Discrepancy-Guided Reconstruction Learning for Image Forgery Detection (ArXiv '23) [Paper]
- Masked Relation Learning for DeepFake Detection (TIFS '23) [Paper]
图像的拼接篡改检测定位
Since 2021
- A Multi-Stream Fusion Network for Image Splicing Localization (MMM '23) [Paper]
- Attacking Image Splicing Detection and Localization Algorithms Using Synthetic Traces (arXiv '23) [Paper]
- Biomedical Image Splicing Detection using Uncertainty-Guided Refinement (arXiv '23) [Paper]
- A New Method to Detect Splicing Image Forgery Using Convolutional Neural Network (Applied Science (IF: 2.8, not included in CCFs), MDPI, '23) [Paper]
- Multi-scale Target-Aware Framework for Constrained Image Splicing Detection and Localization (MM '23) [Paper]
- Multi-Task SE-Network for Image Splicing Localization (TCSVT '22) [Paper] [Code]
- ET: Edge-Enhanced Transformer for Image Splicing Detection (SPL '22) [Paper]
- Image splicing forgery detection by combining synthetic adversarial networks and hybrid dense U-net based on multiple spaces (IJIS '22) [Paper] [Code]
- SISL:Self-Supervised Image Signature Learning for Splicing Detection & Localization (CVPRW '22) [Paper]
- Deep Metric Color Embeddings for Splicing Localization in Severely Degraded Images (TIFS '22) [Paper]
- Coarse-to-fine-grained method for image splicing region detection (PR '22) [Paper]
- CAT-Net: Compression Artifact Tracing Network for Detection and Localization of Image Splicing (WACV '21) [Paper] [Code]
- Image Splicing Detection, Localization and Attribution via JPEG Primary Quantization Matrix Estimation and Clustering (TIFS '21) [Paper] [Code]
- Multiple Image Splicing Dataset (MISD): A Dataset for Multiple Splicing (Data, MDPI '21) [Paper]
- Reality Transform Adversarial Generators for Image Splicing Forgery Detection and Localization (ICCV '21) [Paper]
- Multi-Task Wavelet Corrected Network for Image Splicing Forgery Detection and Localization (ICME '21) [Paper]
- Detection and Localization of Multiple Image Splicing Using MobileNet V1 (IEEE Access '21) [Paper]
2020 and before
- D-Unet: A Dual-encoder U-Net for Image Splicing Forgery Detection and Localization (arXiv '20) [Paper]
- Exposing splicing forgery in realistic scenes using deep fusion network (InfoS '20) [Paper]
- Locating splicing forgery by adaptive-SVD noise estimation and vicinity noise descriptor (Neurocomputing '20) [Paper]
- Adversarial Learning for Constrained Image Splicing Detection and Localization Based on Atrous Convolution (TIFS '19) [Paper] [Code]
- RRU-Net: The Ringed Residual U-Net for Image Splicing Forgery Detection (CVPRW' 19) [Paper] [Code]
- Mixed adversarial generators for image splice detection (NeuIPS '19) [Paper] [Code]
- Image Splicing Localization via Semi-global Network and Fully Connected Conditional Random Fields (ECCV '18)
- Image splicing localization using a multi-task fully convolutional network (mfcn) (JVCIR '18) [Paper] [Code]
- Fighting Fake News: Image Splice Detection via Learned Self-Consistency (ECCV '18) [Paper] [Code]
- Deep Fusion Network for Splicing Forgery Localization (ECCV '18)
- Deep matching and validation network: An end-to-end solution to constrained image splicing localization and detection (MM '17) [Paper]
图像协调化
- Toward Realistic Image Compositing with Adversarial Learning (CVPR '19) [Paper] [Code_unofficial]
- Image Harmonization with Transformer (ICCV '21) [Paper]
- SSH: A Self-Supervised Framework for Image Harmonization (ICCV '21) [Paper] [Code]
- Image Harmonization with Region-wise Contrastive Learning (ArXiv '22) [Paper]
- Harmonizer: Learning to Perform White-Box Image and Video Harmonization (ECCV '22) [Paper] [Code]
- Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization (ECCV '22) [Paper] [Code]
- High-Resolution Image Harmonization via Collaborative Dual Transformations (CVPR '22) [Paper] [Code_unofficial]
- SCS-Co: Self-Consistent Style Contrastive Learning for Image Harmonization (CVPR '22) [Paper] [Code]
- PCT-Net: Full Resolution Image Harmonization Using Pixel-Wise Color Transformations (CVPR '23)
- Semi-supervised Parametric Real-world Image Harmonization (CVPR '23) [Paper] [Code] [Project]
- LEMaRT: Label-Efficient Masked Region Transform for Image Harmonization(CVPR '23) [Paper]
- Burstormer: Burst Image Restoration and Enhancement Transformer (CVPR '23) [Paper] [Code]
人脸篡改，篡改方法以及检测问题
- SSTNet: Detecting Manipulated Faces Through Spatial, Steganalysis and Temporal Features (ICASSP '20) [Paper]
- Portrait shadow manipulation (ACM MM / TOG '20) [Paper] [Code]
- MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection (KBS '22) [Paper]
- Multi-Scale Wavelet Transformer for Face Forgery Detection (ACCV '22) [Paper]
- Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection (CVPR '22) [Paper] [Code]
- AUNet: Learning Relations Between Action Units for Face Forgery Detection (CVPR '23) [Paper]
- AltFreezing for More General Face Forgery Detection (CVPR '23) [Paper] **[Code]88
- $F^2$Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection (TIFS '23) [Paper]
- On the Security of the One-and-a-Half-Class Classifier for SPAM Feature-Based Image Forensics (TIFS '23) [Paper]
- Multimodaltrace: Deepfake Detection Using Audiovisual Representation Learning (CVPRW '23) [Paper]
- Two-in-one Knowledge Distillation for Efficient Facial Forgery Detection (arXiv '23') [Paper]
- Contrastive Multi-FaceForensics: An End-to-end Bi-grained Contrastive Learning Approach for Multi-face Forgery Detection (arXiv '23') [Paper]
- Learning Patch-Channel Correspondence for Interpretable Face Forgery Detection (TIP '23) [Paper] [Code]
- Not All Steps are Created Equal: Selective Diffusion Distillation for Image Manipulation (ICCV '23) [Paper] [Code]
复制移动篡改定位问题
- BusterNet: Detecting Copy-Move Image Forgery with Source/Target Localization (ECCV '18) [Paper] [Code]
- A Serial Image Copy-Move Forgery Localization Scheme With Source/Target Distinguishment (TMM '20) [Paper] [Code]
- DOA-GAN: Dual-Order Attentive Generative Adversarial Network for Image Copy-Move Forgery Detection and Localization (CVPR '20) [Paper] [Code]
- Two-Stage Copy-Move Forgery Detection with Self Deep Matching and Proposal SuperGlue (TIP '22) [Paper]
- QDL-CMFD: A Quality-independent and deep Learning-based Copy-Move image forgery detection method (Neurocomputing '22) [Paper] [Code]
- Shrinking the Semantic Gap: Spatial Pooling of Local Moment Invariants for Copy-Move Forgery Detection (TIFS '23) [Paper] [Code]
- Image Copy-Move Forgery Detection via Deep Cross-Scale PatchMatch (ICME '23) [Paper]
特征匹配，图像匹配问题。
- LoFTR: Detector-Free Local Matching with Transformers (CVPR '21) [Paper] [Code]
- PATS: Patch Area Transportation with Subdivision for Local Feature Matching (CVPR '23) [Paper] [Code] [Project]
- Adaptive Spot-Guided Transformer for Consistent Local Feature Matching (CVPR '23) [Paper] [Code] [Project]
- ObjectMatch: Robust Registration using Canonical Object Correspondences (CVPR '23) [Paper] [Code] [Project]
目标检测，包括伪装物体目标检测和突出目标检测，COD以及SOD。
- OTA: Optimal Transport Assignment for Object Detection (CVPR '21) [Paper] [Code]
- Consistency-basd Active Learning for Object Detection (CVPRW '22) [Paper] [Code]
- Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detection (CVPR '22) [Paper] [Code]
- Unsupervised Object Localization: Observing the Background to Discover Objects (CVPR '23) [Paper] [Code]
- Camouflaged Object Detection with Feature Decomposition and Edge Reconstruction (CVPR '23) [Paper] [Code]
- Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformers (CVPR '23) [Paper] [Code]
- Locate, Refine and Restore: A Progressive Enhancement Network for Camouflaged Object Detection (IJCAI '23) [Paper]
- Spatial-Aware Token for Weakly Supervised Object Localization (ICCV '23) [Paper] [Code]
- Generative Prompt Model for Weakly Supervised Object Localization (ICCV '23) [Paper] [Code]
- Category-aware Allocation Transformer for Weakly Supervised Object Localization (ICCV '23) [Paper]
语义分割，将图片中完整语义（具有标签或者类别）的部分分割出来。不仅要进行目标检测检测到图像中的物体，还需要对每个像素分类。
- Generative Semantic Segmentation (CVPR '23) [Paper] [Code]
- EfficientViT: Lightweight Multi-Scale Attention for On-Device Semantic Segmentation [Paper] [Code]
- CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentation [Paper] [Code] [Project] [Note_community]
Related resources:
- https://github.com/Kobaayyy/Awesome-ICCV2021-Low-Level-Vision
- https://github.com/lcybuzz/Low-Level-Vision-Paper-Record
Low-level tasks include super-resolution, denoise, dehze, low-light enhancement, etc. High-level tasks include classification, detection, segmentation, etc. segmentation, and so on. However, the ones I have listed here are probably still mainly related to tampering detection.
Testing the new layout of paper title.
📖Paper, 👨💻Code, 📦Dataset, 🔗Other links, 📜News,
*Equal contribution. #Corresponding author.
-
(EVP) Explicit Visual Prompting for Low-Level Structure Segmentations (CVPR '23) 📖, 👨💻 (including defocus blur, shadow, forgery, camouflaged dection)
Weihuang Liu1, Xi Shen2, Chi-Man Pun#,1, Xiaodong Cun#,2
1University of Macau 2Tencent AI Lab
-
SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Device (ICCV '23) 📖, 👨💻
Weiran Gou∗1,2, Ziyao Yi∗1,2, Yan Xiang1,2, Shaoqing Li1,2, Zibin Liu1,2, Dehui Kong1,2, Ke Xu#1,2
1State Key Laboratory of Mobile Network and Mobile Multimedia Technology, 2Sanechips Technology, Chengdu, China
-
Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Vision (arXiv '23_) 📖, 👨💻
Haoning Wu1*, Zicheng Zhang2*, Erli Zhang1*, Chaofeng Chen1, Liang Liao1, Annan Wang1, Chunyi Li2, Wenxiu Sun3, Qiong Yan3, Guangtao Zhai2, Weisi Lin1#
1Nanyang Technological University, 2Shanghai Jiaotong University, 3Sensetime Research
- ICCV 2023 Paper List https://huggingface.co/spaces/ICCV2023/ICCV2023-papers
- ICLR 2023 Papers List https://openreview.net/group?id=ICLR.cc/2023/Conference
- CVPR 2023 Accepted Papers https://cvpr2023.thecvf.com/Conferences/2023/AcceptedPapers
- CVPR 2023 Workshops https://openaccess.thecvf.com/CVPR2023_workshops/menu
- WACV 2023 Papers https://openaccess.thecvf.com/WACV2023
- IJCAI 2023 Accepted Papers List https://ijcai-23.org/main-track-accepted-papers/
- ECCV 2022 Accepted papers https://eccv2022.ecva.net/program/accepted-papers/
- MM 2022 Proceedings https://dl.acm.org/doi/proceedings/10.1145/3503161
- SIGGRAPH unofficial https://kesen.realtimerendering.com/ eg SIGGRAPH 2023 https://kesen.realtimerendering.com/sig2023.html
- ICML 2022 https://dblp.org/db/conf/icml/icml2022.html
- AAAI 2022 https://dblp.org/db/conf/aaai/aaai2022.html
- TIFS https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=10206
- More...