Skip to content

Latest commit

 

History

History
445 lines (357 loc) · 39.2 KB

README.md

File metadata and controls

445 lines (357 loc) · 39.2 KB

Diffusion Model Papers

Diffusion Model Survey:

Title First Author Conference/Journal Link Code
A survey on generative diffusion model Hanqun Cao Arxiv paper code
Diffusion Models for Time Series Applications: A Survey Lequan Lin Arxiv paper -
Diffusion models for medical image analysis: A comprehensive survey Amirhossein Kazerouni Arxiv paper code
A Comprehensive Survey on Knowledge Distillation of Diffusion Models Weijian Luo Arxiv paper -
A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material Mengchun Zhang Arxiv paper -
Audio Diffusion Model for Speech Synthesis: A Survey on Text To Speech and Speech Enhancement in Generative AI Chenshuang Zhang Arxiv paper -
Diffusion Models in NLP: A Survey Hao Zou Arxiv paper -
Text-to-image Diffusion Models in Generative AI: A Survey Chenshuang Zhang Arxiv paper -
Diffusion Models for Non-autoregressive Text Generation: A Survey Yifan Li IJCAI survey track paper code
Diffusion Models in Bioinformatics: A New Wave of Deep Learning Revolution in Action Zhiye Guo Arxiv paper -
Generative Diffusion Models on Graphs: Methods and Applications Chengyi Liu Arxiv paper -
Efficient Diffusion Models for Vision: A Survey Anwaar Ulhaq Arxiv paper -
Diffusion Models in Vision: A Survey Florinel-Alin Croitoru TPAMI paper -
A Survey on Generative Diffusion Model Hanqun Cao Arxiv paper -
Diffusion Models: A Comprehensive Survey of Methods and Applications Ling Yang Arxiv paper code
Ai-generated content (aigc): A survey Jiayang Wu Arxiv paper -
A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need? Chaoning Zhang Arxiv paper -

Diffusion Model Theory:

Crucial:

Title First Author Conference/Journal Link Code
Denoising Diffusion Probabilistic Models Jonathan Ho NIPS paper code
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song ICLR best paper paper code
Denoising Diffusion Implicit Models Jiaming Song ICLR paper code
Consistency Models Yang Song ICML paper code
Variational diffusion models Diederik Kingma NIPS paper code
Deep Unsupervised Learning using Nonequilibrium Thermodynamics Jascha Sohl-Dickstein PMLR paper code
Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models Fan Bao ICLR paper code
Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow Xingchao Liu ICLR paper code
Elucidating the Design Space of Diffusion-Based Generative Models Tero Karras NIPS paper code
Improved Denoising Diffusion Probabilistic Models Alex Nichol ICML paper code
Maximum likelihood training of score-based diffusion models Yang Song NIPS paper code

SDE/ODE/Flow

Title First Author Conference/Journal Link Code
On enhancing the robustness of Vision Transformers: Defensive Diffusion Raza Imam Arxiv paper code
Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model Xiulong Yang Arxiv paper code
Your Diffusion Model is Secretly a Zero-Shot Classifier Alexander C. Li Arxiv paper code
SVDiff: Compact Parameter Space for Diffusion Fine-Tuning Ligong Han Arxiv paper code
Stochastic Interpolants: A Unifying Framework for Flows and Diffusions Michael S. Albergo Arxiv paper -
Rectified Flow: A Marginal Preserving Approach to Optimal Transport Qiang Liu Arxiv paper -
Minimizing Trajectory Curvature of ODE-based Generative Models Sangyun Lee ICML paper code
Convergence of score-based generative modeling for general data distributions Holden Lee NIPS workshop paper -
Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions Sitian Chen ICLR paper -
Flow Matching for Generative Modeling Yaron Lipman Arxiv paper -
Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models Fan Bao ICML paper code
Expressiveness Remarks for Denoising Diffusion Models and Samplers Francisco Vargas Arxiv paper -
The Score-Difference Flow for Implicit Generative Modeling Romann M. Weber Arxiv paper -
Diffusion Models for Constrained Domains Nic Fishman Arxiv paper -
Diffusion Bridge Mixture Transports, Schrödinger Bridge Problems and Generative Modeling Stefano Peluchetti Arxiv paper -
Efficient Sampling of Stochastic Differential Equations with Positive Semi-Definite Models Anant Raj Arxiv paper -
Diffusion Schrödinger Bridge Matching Yuyang Shi Arxiv paper -
Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplers Sitan Chen Arxiv paper -
Diffusion Models are Minimax Optimal Distribution Estimators Kazusato Oko ICLR workshop paper -
Understanding the Diffusion Objective as a Weighted Integral of ELBOs Diederik P. Kingma Arxiv paper -
Continuous-Time Functional Diffusion Processes Giulio Franzese Arxiv paper -
Denoising Diffusion Samplers Francisco Vargas Arxiv paper -
Infinite-Dimensional Diffusion Models for Function Spaces Jakiw Pidstrigach Arxiv paper -
Score-based Diffusion Models in Function Space Jae Hyun Lim Arxiv paper -
Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data Minshuo Chen Arxiv paper -
Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent Benjamin Gess Arxiv paper -
Monte Carlo Neural Operator for Learning PDEs via Probabilistic Representation Rui Zhang Arxiv paper -
Example-Based Sampling with Diffusion Models Bastien Doignies Arxiv paper -
Information-Theoretic Diffusion Xianghao Kong ICLR paper code
Conditional Flow Matching: Simulation-Free Dynamic Optimal Transport Alexander Tong Arxiv paper code
Transport with Support: Data-Conditional Diffusion Bridges Ella Tamir Arxiv paper -
Understanding and contextualising diffusion models Stefano Scotta Arxiv paper code
On the Mathematics of Diffusion Models David McAllester Arxiv paper -
Mathematical analysis of singularities in the diffusion model under the submanifold assumption Yubin Lu Arxiv paper -
Thompson Sampling with Diffusion Generative Prior Yu-Guan Hsieh Arxiv paper -
Your diffusion model secretly knows the dimension of the data manifold Jan Stanczuk Arxiv paper -
Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance Dohyun Kwon NIPS paper code
Nonlinear controllability and function representation by neural stochastic differential equations Tanya Veeravalli Arxiv paper -
Diffusion Generative Models in Infinite Dimensions Gavin Kerrigan AISTATS paper code
Neural Langevin Dynamics: towards interpretable Neural Stochastic Differential Equations Simon M. Koop Arxiv paper -
Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptions Hongrui Chen Arxiv paper -
Categorical SDEs with Simplex Diffusion Pierre H. Richemond Arxiv paper -
Diffusion Models for Causal Discovery via Topological Ordering Pedro Sanchez Arxiv paper code
Regularizing Score-based Models with Score Fokker-Planck Equations Chieh-Hsin Lai NIPS workshop paper -
Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models Louis Sharrock Arxiv paper -
Analyzing diffusion as serial reproduction Raja Marjieh Arxiv paper -
Convergence of score-based generative modeling for general data distributions Holden Lee NIPS workshop paper -
Riemannian Diffusion Models Chin-Wei Huang NIPS paper -
Convergence of denoising diffusion models under the manifold hypothesis Valentin De Bortoli TMLR paper -
Neural Diffusion Processes Vincent Dutordoir Arxiv paper code
Theory and Algorithms for Diffusion Processes on Riemannian Manifolds Bowen Jing NIPS paper code
Riemannian Score-Based Generative Modelling Valentin De Bortoli NIPS paper code
Interpreting diffusion score matching using normalizing flow Wenbo Gong ICLR workshop paper -
Diffusion normalizing flow Zhang, Qinsheng NIPS paper code
Maximum Likelihood Training of Implicit Nonlinear Diffusion Models Dongjun Kim NIPS paper code
Score-based generative modeling in latent space Vahdat, Arash NIPS paper code
Maximum Likelihood Training of Parametrized Diffusion Model Dongjun Kim ICLR reject paper -
Soft truncation: A universal training technique of score-based diffusion model for high precision score estimation Dongjun Kim ICML paper code
Robust Classification via a Single Diffusion Model Huanran Chen Arxiv paper -
Maximum Likelihood Training for Score-Based Diffusion ODEs by High-Order Denoising Score Matching Cheng Lu ICML paper code
Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs Kaiwen Zheng ICML paper -
Direct Diffusion Bridge using Data Consistency for Inverse Problems Hyungjin Chung Arxiv paper -

Architecture

Title First Author Conference/Journal Link Code
All are Worth Words: A ViT Backbone for Diffusion Models Fan Bao CVPR paper code

Diffusion Model Application:

** Note: In this title, we just summarize works that use diffusion models for their specific domains, rather than using their specific domains for diffusion models. Thus, no works can be listed in parameter pruning, model quantization.**

** Note: For a field, if there is no relevant work listed in it, most likely because I haven't put it up yet.**

Crucial:

Title First Author Conference/Journal Link Code
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal NIPS paper code
Classifier-Free Diffusion Guidance Jonathan Ho NIPS workshop paper code
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole ICLR paper code

NeRF:

Title First Author Conference/Journal Link Code
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole ICLR paper code
Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation Haochen Wang CVPR paper code
Magic3D: High-Resolution Text-to-3D Content Creation Chen-Hsuan Lin CVPR paper code
Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation Rui Chen Arxiv paper code
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures Gal Metzer CVPR paper code
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation Zhengyi Wang Arxiv paper code
ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Image Zhenzhen Weng Arxiv paper -

GNN:

Title First Author Conference/Journal Link Code
Grand: Graph neural diffusion B Chamberlain NIPS workshop/ICML paper code
Neural sheaf diffusion: A topological perspective on heterophily and oversmoothing in gnns C Bodnar NIPS paper -
Graph Neural Networks as Gradient Flows: understanding graph convolutions via energy Francesco Di Giovanni Arxiv paper -

Reid:

Title First Author Conference/Journal Link Code
Person image synthesis via denoising diffusion model AK Bhunia CVPR paper code

Long-tail Distribution:

Title First Author Conference/Journal Link Code
DiffBFR: Bootstrapping Diffusion Model Towards Blind Face Restoration Xinmin Qiu Arxiv paper -
Class-Balancing Diffusion Models Yiming Qin CVPR paper -

2D/3D Vision-Language:

Title First Author Conference/Journal Link Code
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole ICLR paper code
Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation Haochen Wang CVPR paper code
Magic3D: High-Resolution Text-to-3D Content Creation Chen-Hsuan Lin CVPR paper code
Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation Rui Chen Arxiv paper code
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures Gal Metzer CVPR paper code
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation Zhengyi Wang Arxiv paper code
SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Seconds Yanyu Li Arxiv paper -

Self-supervised Learning:

Title First Author Conference/Journal Link Code
Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstruction Zhuo-Xu Cui Arxiv paper -
Diffusion adversarial representation learning for self-supervised vessel segmentation Boah Kim ICLR paper -
DDM: Self-Supervised Diffusion MRI Denoising with Generative Diffusion Models Tiange Xiang ICLR paper code
Learning 3D Photography Videos via Self-supervised Diffusion on Single Images Xiaodong Wang Arxiv paper -
DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration Yuchun Miao Arxiv paper -
Data-Centric Learning from Unlabeled Graphs with Diffusion Model Gang Liu Arxiv paper code
Denoising Diffusion Autoencoders are Unified Self-supervised Learners Weilai Xiang Arxiv paper -

Data Augmentation/Expansion:

Title First Author Conference/Journal Link Code
Effective Data Augmentation With Diffusion Models Brandon Trabucco Arxiv paper code
Deep Data Augmentation for Weed Recognition Enhancement: A Diffusion Probabilistic Model and Transfer Learning Based Approach Dong Chen Arxiv paper code
Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Images Mohamed Akrout Arxiv paper -
A data augmentation perspective on diffusion models and retrieval Max F. Burg Arxiv paper -
Multimodal Data Augmentation for Image Captioning using Diffusion Models Changrong Xiao Arxiv paper code
DiffuseExpand: Expanding dataset for 2D medical image segmentation using diffusion models Shitong Shao Arxiv paper code
AugDiff: Diffusion based Feature Augmentation for Multiple Instance Learning in Whole Slide Image Zhuchen Shao Arxiv paper -

Object Detection:

Title First Author Conference/Journal Link Code
Diffusiondet: Diffusion model for object detection Shoufa Chen Arxiv paper code

Visual Tracking:

Semantic Segmentation:

Title First Author Conference/Journal Link Code
Segdiff: Image segmentation with diffusion probabilistic models Tomer Amit Arxiv paper code
Ambiguous Medical Image Segmentation Using Diffusion Models Aimon Rahman CVPR paper code

Instance Segmentation:

Panoptic Segmentation:

Image Resolution:

Title First Author Conference/Journal Link Code
Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Models Ruibin Li Arxiv paper -

Medical:

Image Editing:

Title First Author Conference/Journal Link Code
AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars MOHIT MENDIRATTA Arxiv paper -

Low-level Vision:

Image Matting:

Deblur:

3D-point Cloud:

Video Generation/Understanding/Prediction:

Action Detection:

Dataset Compression:

Knowledge Distillation:

Title First Author Conference/Journal Link Code
Knowledge Diffusion for Distillation Tao Huang Arxiv paper code

Parameter Pruning:

Title First Author Conference/Journal Link Code

Model Quantization:

Title First Author Conference/Journal Link Code

Depth Estimation:

Text Detection:

Anomaly Detection:

3D Reconstruction:

Trajectory Prediction:

Lane Detection:

Image Captioning:

Visual Question Answering:

Sign Language Recognition:

Novel View Synthesis:

Zero/Few-Shot Learning:

Transfer Learning:

Stereo Matching:

Scene Graph Generation:

Image Quality Assessment:

Music:

Title First Author Conference/Journal Link Code
Symbolic Music Generation with Diffusion Models Gautam Mittal ISMIR paper code
Generating symbolic music using diffusion models Lilac Atassi Arxiv paper code
Solving Audio Inverse Problems with a Diffusion Model Eloi Moliner ICASSP paper -
DiffuseRoll: Multi-track multi-category music generation based on diffusion model Hongfei Wang Arxiv paper -
MAID: A Conditional Diffusion Model for Long Music Audio Inpainting Kaiyang Liu ICASSP paper -
EDGE: Editable Dance Generation From Music Jonathan Tseng CVPR paper code

Speech:

Title First Author Conference/Journal Link Code
Prodiff: Progressive fast diffusion model for high-quality text-to-speech Rongjie Huang ACMMM paper code
Diff-TTS: A Denoising Diffusion Model for Text-to-Speech Myeonghun Jeong Arxiv paper code
Fastdiff: A fast conditional diffusion model for high-quality speech synthesis Rongjie Huang IJCAI paper code
Guided-tts: A diffusion model for text-to-speech via classifier guidance Heeseung Kim ICML paper -
Restoring degraded speech via a modified diffusion model Jianwei Zhang Arxiv paper -
DiffMotion: Speech-Driven Gesture Synthesis Using Denoising Diffusion Model Fan Zhang MMM paper code

GflowNet:

Title First Author Conference/Journal Link Code
Generative Flow Networks for Discrete Probabilistic Modeling Dinghuai Zhang NIPS paper code
ROBUST SCHEDULING WITH GFLOWNETS David W. Zhang ICLR paper code
Flow Network based Generative Models for Non-Iterative Diverse Candidate Generation Emmanuel Bengio NIPS paper code
Biological Sequence Design with GFlowNets Moksh Jain ICML paper code
Bayesian Structure Learning with Generative Flow Networks Tristan Deleu NIPS paper code
Trajectory balance: Improved credit assignment in GFlowNets Nikolay Malkin NIPS paper code
A theory of continuous generative flow networks Salem Lahlou ICML paper code
Better Training of GFlowNets with Local Credit and Incomplete Trajectories Ling Pan Arxiv paper -
Unifying Generative Models with GFlowNets and Beyond Dinghuai Zhang ICML workshop paper -
A Max-Flow Based Approach for Neural Architecture Search Chao Xue ECCV paper -
Multi-Objective GFlowNets Moksh Jain Arxiv paper -
Towards Understanding and Improving GFlowNet Training Max W. Shen ICML paper code
torchgfn: A PyTorch GFlowNet library Salem Lahlou Arxiv paper code

Generative Steganography:

Title First Author Conference/Journal Link Code
Diffusion-Stego: Training-free Diffusion Generative Steganography via Message Projection Daegyu Kim Arxiv paper -

Quality Diversity Reinforcement Learning:

Title First Author Conference/Journal Link Code
Generating Behaviorally Diverse Policies with Latent Diffusion Models Shashank Hegde Arxiv paper -

Diffusion Model Compression/Accelerated Sampling:

Accelerated Sampling

Title First Author Conference/Journal Link Code
Fast Sampling of Diffusion Models with Exponential Integrator Qinsheng Zhang ICLR paper code
Fast Sampling of Diffusion Models via Operator Learning Hongkai Zheng NIPS workshop paper -
Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models Muyang Li NIPS paper code
DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps Cheng Lu NIPS paper code
BOOMERANG: LOCAL SAMPLING ON IMAGE MANIFOLDS USING DIFFUSION MODELS Lorenzo Luzi Arxiv paper -
Accelerating Guided Diffusion Sampling with Splitting Numerical Methods Suttisak Wizadwongsa ICLR paper code
Quasi-Taylor Samplers for Diffusion Generative Models based on Ideal Derivatives Hideyuki Tachibana Arxiv paper -
Denoising MCMC for Accelerating Diffusion-Based Generative Models Beomsu Kim Arxiv paper code
DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models Cheng Lu Arxiv paper code
Consistency Models Yang Song ICML paper code
Catch-Up Distillation: You Only Need to Train Once for Accelerating Sampling Shitong Shao Arxiv paper code
Progressive Distillation for Fast Sampling of Diffusion Models Tim Salimans ICLR paper code
ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speech Rongjie Huang ACMMM paper code
Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed Eric Luhman Arxiv paper code
Accelerating Diffusion Models via Early Stop of the Diffusion Process Zhaoyang Lyu Arxiv paper code
Truncated diffusion probabilistic models Huangjie Zheng ICLR paper code
How Much is Enough? A Study on Diffusion Times in Score-based Generative Models Giulio Franzese Arxiv paper -
gDDIM: Generalized denoising diffusion implicit models Qinsheng Zhang ICLR paper code
Pseudo Numerical Methods for Diffusion Models on Manifolds Luping Liu ICLR paper code
Gotta Go Fast When Generating Data with Score-Based Models Alexia Jolicoeur-Martineau Arxiv paper code
Learning Fast Samplers for Diffusion Models by Differentiating Through Sample Quality Daniel Watson ICLR paper -
Learning to Efficiently Sample from Diffusion Probabilistic Models Daniel Watson Arxiv paper -
On Distillation of Guided Diffusion Models Chenlin Meng CVPR paper -
Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models Weijian Luo Arxiv paper -

Model Compression

Title First Author Conference/Journal Link Code
Diffusion Probabilistic Model Made Slim Xingyi Yang CVPR paper -
LOSSY COMPRESSION WITH GAUSSIAN DIFFUSION Lucas Theis ICLR paper -
PTQD: Accurate Post-Training Quantization for Diffusion Models Yefei He Arxiv paper -
Compressing and Accelerating Stable Diffusion Alex Kashi Arxiv paper -
Q-Diffusion: Quantizing Diffusion Models Xiuyu Li Arxiv paper -
Speed Is All You Need: On-Device Acceleration of Large Diffusion Models via GPU-Aware Optimizations Yu-Hui Chen Arxiv paper -
Token Merging for Fast Stable Diffusion Daniel Bolya Arxiv paper code
Diffumask: Synthesizing images with pixel-level annotations for semantic segmentation using diffusion models Weijia Wu Arxiv code -
On Architectural Compression of Text-to-Image Diffusion Models Bo-Kyeong Kim Arxiv paper -
Distilling the Knowledge in Diffusion Models Tim Dockhorn CVPR workshop paper -