Skip to content

Latest commit

 

History

History
497 lines (400 loc) · 69.8 KB

README.md

File metadata and controls

497 lines (400 loc) · 69.8 KB
description
Deep learning papers notes sharing, especially for image forgery detection and localization

😀 Overview

ccf-rankings now marked with different colors(arXiv Static Badge Static Badge Static Badge)1

Newly added papers will be organized at the top of every category now.

Related

Basics

Backbone

骨干网络,多为图像分类的网络。

Image Tampering

图像篡改检测定位

Image Editing

2025
  • SAFIRE: Segment Any Forged Image Region Static Badge GitHub
2024
  • Omni-IML: Towards Unified Image Manipulation Localization Static Badge
  • ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detection Static Badge
  • SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model Static Badge
  • Dual JPEG Compatibility: a Reliable and Explainable Tool for Image Forensics Static Badge
  • Is JPEG AI going to change image forensics? Static Badge
  • Image Forgery Localization via Guided Noise and Multi-Scale Feature Aggregation Static Badge
  • Image manipulation localization via dynamic cross-modality fusion and progressive integration Static Badge
  • HRGR: Enhancing Image Manipulation Detection via Hierarchical Region-aware Graph Reasoning Static Badge
  • Language-guided Hierarchical Fine-grained Image Forgery Detection and Localization (HiFi-Net++) paper GitHub
  • Image Manipulation Detection With Implicit Neural Representation and Limited Supervision conf
  • AdaIFL: Adaptive Image Forgery Localization via a Dynamic and Importance-aware Transformer Network conf
  • Noise-assisted Prompt Learning for Image Forgery Detection and Localization conf
  • Learning Universal Features for Generalizable Image Forgery Localization Static Badge
  • A Large-scale Interpretable Multi-modality Benchmark for Image Forgery Localization Static Badge
  • ForgeryTTT: Zero-Shot Image Manipulation Localization with Test-Time Training Static Badge
  • ForgeryGPT: Multimodal Large Language Model For Explainable Image Forgery Detection and Localization Static Badge
  • FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Models Static Badge GitHub
  • FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models Static Badge GitHub
  • EL-FDL: Improving Image Forgery Detection and Localization via Ensemble Learning conf
  • Unified Frequency-Assisted Transformer Framework for Detecting and Grounding Multi-Modal Manipulation paper
  • Detecting and Grounding Multi-Modal Media Manipulation and Beyond paper GitHub
  • FastForensics: Efficient Two-Stream Design for Real-Time Image Manipulation Detection conf
  • Auto-focus tracing: Image manipulation detection with artifact graph contrastive Static Badge GitHub
  • LookupForensics: A Large-Scale Multi-Task Dataset for Multi-Phase Image-Based Fact Verification Static Badge
  • Image manipulation detection and localization using multi-scale contrastive learning paper
  • Attentive and Contrastive Image Manipulation Localization With Boundary Guidance paper
  • Multi-view Feature Extraction via Tunable Prompts is Enough for Image Manipulation Localization paper
  • Datasets, Clues and State-of-the-Arts for Multimedia Forensics: An Extensive Review Static Badge
  • TGIF: Text-Guided Inpainting Forgery Dataset Static Badge GitHub
  • Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localization Static Badge GitHub
  • GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localization Static Badge GitHub
  • IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localization Static Badge GitHub
  • DH-GAN: Image manipulation localization via a dual homology-aware generative adversarial network Static Badge
  • DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attention Static Badge
  • EC-Net: General image tampering localization network based on edge distribution guidance and contrastive learning Static Badge
  • Frequency-constrained transferable adversarial attack on image manipulation detection and localization Static Badge
  • A Contribution-Aware Noise Feature representation model for image manipulation localization Static Badge
  • Effective Image Tampering Localization via Enhanced Transformer and Co-attention Fusion Static Badge GitHub
  • PROMPT-IML: Image Manipulation Localization with Pre-trained Foundation Models Through Prompt Tuning Static Badge
  • Diffusion models meet image counter-forensics Static Badge GitHub
  • Research about the Ability of LLM in the Tamper-Detection Area Static Badge
  • Deep Image Restoration For Image Anti-Forensics Static Badge GitHub
  • Deep Image Composition Meets Image Forgery Static Badge GitHub
  • Fusion Transformer with Object Mask Guidance for Image Forgery Analysis Static Badge GitHub
  • Exploring Multi-Modal Fusion for Image Manipulation Detection and Localization arXiv GitHub
  • A New Benchmark and Model for Challenging Image Manipulation Detection arXiv GitHub
  • MGQFormer: Mask-Guided Query-Based Transformer for Image Manipulation Localization arXiv arXiv
  • Learning Discriminative Noise Guidance for Image Forgery Detection and Localization arXiv
  • CatmullRom Splines-Based Regression for Image Forgery Localization arXiv
  • UnionFormer: Unified-Learning Transformer with Multi-View Representation for Image Manipulation Detection and Localization arXiv
  • Towards Modern Image Manipulation Localization: A Large-Scale Dataset and Novel Methods arXiv GitHub
  • EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protection arXiv GitHub
  • DiffForensics: Leveraging Diffusion Prior to Image Forgery Detection and Localization arXiv
  • IML-ViT: Image Manipulation Localization by Vision Transformer arXiv GitHub
  • CIMGEN: Controlled Image Manipulation by Finetuning Pretrained Generative Models on Limited Data arXiv
2023
2022
2021
  • Multi-modality image manipulation detection (ICME '21) [Paper]
  • MSTA-Net: Forgery Detection by Generating Manipulation Trace Based on Multi-Scale Self-Texture Attention (TCSVT '21) [Paper]
  • Image Manipulation Detection by Multi-View Multi-Scale Supervision (ICCV '21) [Paper] [Code]
  • TransForensics: Image Forgery Localization with Dense Self-Attention (ICCV '21) [Paper]
  • Self-supervised Domain Adaptation for Forgery Localization of JPEG Compressed Images (ICCV '21) [Paper]
  • Image Tampering Localization Using a Dense Fully Convolutional Network (TIFS '21) [Paper] [Code] (DenseFCN)
  • Image Manipulation Localization Using Attentional Cross-Domain CNN Features (TNNLS '21) [Paper]
2020 and before

CNN-synthesized

Some of the above papers also contain methods to detect tampered images generated by GANs or DMs for synthetic images

  • Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detection (CVPR '24) [Paper]
  • Preserving Fairness Generalization in Deepfake Detection (CVPR '24) [Paper] [Code]
  • Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detection (ECCV '24) [Paper] [Code]
  • Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detection (arXiv '23) [Paper]
  • AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors (arXiv '23) [Paper] [Code]
  • MaLP: Manipulation Localization Using a Proactive Scheme (CVPR '23) [Paper] [Code]
  • Discrepancy-Guided Reconstruction Learning for Image Forgery Detection (IJCAI '23) [Paper] [Code]
  • Generalizable Synthetic Image Detection via Language-guided Contrastive Learning (arXiv '23) [Paper] [Code]
  • Detect Any Deepfakes: Segment Anything Meets Face Forgery Detection and Localization (arXiv '23) [Paper] [Code]
  • Discrepancy-Guided Reconstruction Learning for Image Forgery Detection (arXiv '23) [Paper]
  • Masked Relation Learning for DeepFake Detection (TIFS '23) [Paper]

Image Splicing

图像的拼接篡改检测定位

2024
  • D-Net: A dual-encoder network for image splicing forgery detection and localization Static Badge
  • UGEE-Net: Uncertainty-Guided and Edge-Enhanced Network for Image Splicing Localization (Neural Networks '24) [Paper] [Dataset]
  • Research on Splicing Image Detection Algorithms Based on Natural Image Statistical Characteristics (arXiv '24) [Paper]
  • A Visually Attentive Splice Localization Network with Multi-Domain Feature Extractor and Multi-Receptive Field Upsampler (arXiv '24) [Paper]
  • Feature Aggregation and Region-Aware Learning for Detection of Splicing Forgery (SPL '24) [Paper]
  • Towards Effective Image Forensics via A Novel Computationally Efficient Framework and A New Image Splice Dataset ( Signal, Image and Video Processing (IF: 2.3, not included in CCFs), '24 ) [Paper]
2023
  • GreatSplicing: A Semantically Rich Splicing Dataset (arXiv '23) [Paper] [Dataset]
  • Multi-scale attention context-aware network for detection and localization of image splicing: Efficient and robust identification network (Appl. Intell. 23') [Paper]
  • A Multi-Stream Fusion Network for Image Splicing Localization (MMM '23) [Paper]
  • Attacking Image Splicing Detection and Localization Algorithms Using Synthetic Traces (TIFS '23) [Paper] [IEEE Paper]
  • Biomedical Image Splicing Detection using Uncertainty-Guided Refinement (arXiv '23) [Paper]
  • A New Method to Detect Splicing Image Forgery Using Convolutional Neural Network (Applied Science (IF: 2.8, not included in CCFs), MDPI, '23) [Paper]
  • Multi-scale Target-Aware Framework for Constrained Image Splicing Detection and Localization (MM '23) [Paper]
2022
2021
2020 and before
  • D-Unet: A Dual-encoder U-Net for Image Splicing Forgery Detection and Localization (arXiv '20) [Paper]
  • Exposing splicing forgery in realistic scenes using deep fusion network (InfoS '20) [Paper]
  • Locating splicing forgery by adaptive-SVD noise estimation and vicinity noise descriptor (Neurocomputing '20) [Paper]
  • Adversarial Learning for Constrained Image Splicing Detection and Localization Based on Atrous Convolution (TIFS '19) [Paper] [Code]
  • RRU-Net: The Ringed Residual U-Net for Image Splicing Forgery Detection (CVPRW' 19) [Paper] [Code]
  • Mixed adversarial generators for image splice detection (NeuIPS '19) [Paper] [Code]
  • Image Splicing Localization via Semi-global Network and Fully Connected Conditional Random Fields (ECCV '18)
  • Image splicing localization using a multi-task fully convolutional network (mfcn) (JVCIR '18) [Paper] [Code]
  • Fighting Fake News: Image Splice Detection via Learned Self-Consistency (ECCV '18) [Paper] [Code]
  • Deep Fusion Network for Splicing Forgery Localization (ECCV '18)
  • Deep matching and validation network: An end-to-end solution to constrained image splicing localization and detection (MM '17) [Paper]

Image Harmonization

图像协调化

Face Forgery

人脸篡改,篡改方法以及检测问题

  • FD-GAN: Generalizable and Robust Forgery Detection via Generative Adversarial Networks paper
  • DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion Static Badge GitHub
  • Can We Leave Deepfake Data Behind in Training Deepfake Detector? arXiv
  • Open-Set Deepfake Detection: A Parameter-Efficient Adaptation Method with Forgery Style Mixture arXiv
  • Hierarchical Forgery Classifier On Multi-modality Face Forgery Clues Static Badge GitHub
  • Identity-Driven Multimedia Forgery Detection via Reference Assistance paper
  • MCS-GAN: A Different Understanding for Generalization of Deep Forgery Detection (TMM '23) [Paper]
  • Exposing the Deception: Uncovering More Forgery Clues for Deepfake Detection (AAAI '24) [Paper] [Code]
  • Contrastive Learning for DeepFake Classification and Localization via Multi-Label Ranking (CVPR '24)
  • Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection (CVPR '24) [Paper]
  • Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection (ICLR '24) [Paper] [Code]
  • Improving Fairness in Deepfake Detection (WACV '24) [Paper] [Code]
  • Weakly-Supervised Deepfake Localization in Diffusion-Generated Images (WACV '24) [Paper] [Code]
  • Controllable Guide-Space for Generalizable Face Forgery Detection (ICCV '23) [Paper]
  • RAIRNet: Region-Aware Identity Rectification for Face Forgery Detection (MM '23) [Paper]
  • Not All Steps are Created Equal: Selective Diffusion Distillation for Image Manipulation (ICCV '23) [Paper] [Code]
  • UCF: Uncovering Common Features for Generalizable Deepfake Detection (ICCV '23) [Paper]
  • Learning Patch-Channel Correspondence for Interpretable Face Forgery Detection (TIP '23) [Paper] [Code]
  • Contrastive Multi-FaceForensics: An End-to-end Bi-grained Contrastive Learning Approach for Multi-face Forgery Detection (arXiv '23') [Paper]
  • Two-in-one Knowledge Distillation for Efficient Facial Forgery Detection (arXiv '23') [Paper]
  • AUNet: Learning Relations Between Action Units for Face Forgery Detection (CVPR '23) [Paper]
  • AltFreezing for More General Face Forgery Detection (CVPR '23) [Paper] **[Code]88
  • $F^2$Trans: High-Frequency Fine-Grained Transformer for Face Forgery Detection (TIFS '23) [Paper]
  • On the Security of the One-and-a-Half-Class Classifier for SPAM Feature-Based Image Forensics (TIFS '23) [Paper]
  • Multimodaltrace: Deepfake Detection Using Audiovisual Representation Learning (CVPRW '23) [Paper]
  • MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection (KBS '22) [Paper]
  • Multi-Scale Wavelet Transformer for Face Forgery Detection (ACCV '22) [Paper]
  • Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection (CVPR '22) [Paper] [Code]
  • SSTNet: Detecting Manipulated Faces Through Spatial, Steganalysis and Temporal Features (ICASSP '20) [Paper]
  • Portrait shadow manipulation (ACM MM / TOG '20) [Paper] [Code]

Copy Move

复制移动篡改定位问题

Image Inpainting

  • Wavelet based inpainting detection paper
  • Enhanced Wavelet Scattering Network for image inpainting detection paper GitHub

Tamper Text in Detection

图像中的文本篡改检测问题 (parts of)

  • Enhancing Tampered Text Detection through Frequency Feature Fusion and Decomposition conf
  • Delving into Adversarial Robustness on Document Tampering Localization conf
  • Image-based Freeform Handwriting Authentication with Energy-oriented Self-Supervised Learning paper
  • Generalized Tampered Scene Text Detection in the era of Generative AI paper
  • A Two-Stage Dual-Path Framework for Text Tampering Detection and Recognition (arXiv '24) [Paper]
  • CTP-Net: Character Texture Perception Network for Document Image Forgery Localization (arXiv '23) [Paper] GitHub
  • Toward Real Text Manipulation Detection: New Dataset and New Solution (arXiv '23) [Paper] [Code]
  • Towards Robust Tampered Text Detection in Document Image: New dataset and New Solution (CVPR '23) [Paper] [Code]
  • Progressive Supervision for Tampering Localization in Document Images (ICONIP '23) [Paper]
  • SigScatNet: A Siamese + Scattering based Deep Learning Approach for Signature Forgery Detection and Similarity Assessment (arXiv '23) [Paper]
  • Image Generation and Learning Strategy for Deep Document Forgery Detection (arXiv '23) [Paper]
  • Forgery-free signature verification with stroke-aware cycle-consistent generative adversarial network (Neurocomputing '22) [Paper] [Code]
  • Document Forgery Detection in the Context of Double JPEG Compression (ICPR '22) [Paper]

Low Level Vision

Related resources:

Low-level tasks include super-resolution, denoise, dehze, low-light enhancement, etc. High-level tasks include classification, detection, segmentation, etc. segmentation, and so on. However, the ones I have listed here are probably still mainly related to tampering detection.

Testing the new layout of paper title.

📖Paper, 👨‍💻Code, 📦Dataset, 🔗Other links, 📜News,

*Equal contribution. #Corresponding author.

Image Matching

特征匹配,图像匹配问题。

Object Detection

目标检测,包括伪装物体目标检测和突出目标检测,COD以及SOD。

  • HEAP: Unsupervised Object Discovery and Localization with Contrastive Grouping (AAAI '24) [Paper]
  • Endow SAM with Keen Eyes: Temporal-spatial Prompt Learning for Video Camouflaged Object Detection (CVPR '24)
  • VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learning (CVPR '24) [Paper]
  • Weakly Supervised Open-Vocabulary Object Detection (AAAI '24) [Paper]
  • OTA: Optimal Transport Assignment for Object Detection (CVPR '21) [Paper] [Code]
  • Consistency-basd Active Learning for Object Detection (CVPRW '22) [Paper] [Code]
  • Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detection (CVPR '22) [Paper] [Code]
  • Unsupervised Object Localization: Observing the Background to Discover Objects (CVPR '23) [Paper] [Code]
  • Camouflaged Object Detection with Feature Decomposition and Edge Reconstruction (CVPR '23) [Paper] [Code]
  • Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformers (CVPR '23) [Paper] [Code]
  • Locate, Refine and Restore: A Progressive Enhancement Network for Camouflaged Object Detection (IJCAI '23) [Paper]
  • Spatial-Aware Token for Weakly Supervised Object Localization (ICCV '23) [Paper] [Code]
  • Generative Prompt Model for Weakly Supervised Object Localization (ICCV '23) [Paper] [Code]
  • Category-aware Allocation Transformer for Weakly Supervised Object Localization (ICCV '23) [Paper]

Semantic Segmentation

语义分割,将图片中完整语义(具有标签或者类别)的部分分割出来。不仅要进行目标检测检测到图像中的物体,还需要对每个像素分类。

Anomaly Detection

异常检测,通常用于发现与正常模式或预期模式不符的图像与视频。

  • Contextual Affinity Distillation for Image Anomaly Detection (WACV '24) [Paper]
  • PromptAD: Zero-Shot Anomaly Detection Using Text Prompts (WACV '24) [Paper]
  • Holistic Representation Learning for Multitask Trajectory Anomaly Detection (WACV '24) [Paper] [Code]

Image Steganography

  • Finding Incompatible Blocks for Reliable JPEG Steganalysis paper
  • LiDiNet: A Lightweight Deep Invertible Network for Image-in-Image Steganography paper

Useful Links

  1. ECCV 2024 Accepted papers https://eccv.ecva.net/virtual/2024/papers.html?filter=titles/
  2. IJCAI 2024 Main Track Accepted Papers https://ijcai24.org/main-track-accepted-papers/
  3. CVPR 2024 Accepted Papers https://cvpr2023.thecvf.com/Conferences/2024/AcceptedPapers
  4. ICLR 2024 Papers List https://openreview.net/group?id=ICLR.cc/2024/Conference
  5. WACV 2024 Papers https://openaccess.thecvf.com/WACV2024
  6. MM 2023 Proceedings https://dl.acm.org/doi/proceedings/10.1145/3581783
  7. ICML 2023 https://dblp.org/db/conf/icml/icml2023.html
  8. ICCV 2023 Paper List https://huggingface.co/spaces/ICCV2023/ICCV2023-papers
  9. AAAI 2023 https://dblp.org/db/conf/aaai/aaai2023.html
  10. SIGGRAPH unofficial https://kesen.realtimerendering.com/ eg SIGGRAPH 2023 https://kesen.realtimerendering.com/sig2023.html
  11. TIFS https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=10206
  12. More...

Footnotes

  1. For the convenience of readers in checking the information of each paper, I have used different colors to mark the ranking of the conferences or journals where each paper was published on the CCF(China Computer Federation) Recommended List of International Conferences and Periodicals: A is marked in red, B in yellow, C in green, and sources not included are marked in grey. All articles are the result of the researchers' hard work, and the development and progress in the field of image tampering detection and localization cannot be separated from these outstanding researchers. "It should be pointed out that the recommended List by CCF for professionals and researchers on computing to publish their findings and results, is not sole criteria for academic evaluation, but as a suggestion or reference for the industry."