3D Gaussian Splatting (3DGS) opens a new window for using neural rendering for real applications. This repo is intended to provide a collection of papers that are related to 3DGS, but not necessarily use 3DGS.
In general, 3D Gaussian Splatting can be considered as a variant of NeRF. This repo will more focused on the practical side of NeRF, e.g. realtime, compatibility with Unity/Unreal, ease of editing, etc.
Other resources:
Verified: Papers listed with [+] have been verfied by myself or colleagues. The code is runnable. Please leave an issue if you need help on setting up.
If you have any additions or suggestions, feel free to contribute. Everything is welcome.
- Aug 2024: added papers for improving NeRF speed
- May 2024: added 2024 section, added LLM subsection
- Dec 2023: added verified section
- 26 Nov 2023: added more details for cumstom data.
- Nov 2023: Start a separate page for NeRF
- 29 Oct 2023: Start a separate page for Dynamic NeRF
- 3D Gaussian Splatting for Real-Time Radiance Field Rendering,
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis, SIGGRAPH 2023 (Best Paper).
[📄 Paper (Low Resolution) | 📄 Paper (High Resolution) | 🌐 Project Page | 💻 Code | 🎥 Short Presentation | 🎥 Explanation Video |
]
- N-BVH: Neural ray queries with bounding volume hierarchies, SIGGRAPH 2024. [Paper | Project | Code]
- High-quality Surface Reconstruction using Gaussian Surfels. [Paper | Code]
- Toon3D: Seeing Cartoons from a New Perspective, 2024. [Paper | Project | Code]
- Texture Generation on 3D Meshes with Point-UV Diffusion, 2024. [Paper | Project | Code]
General
-
[+]2DGS: 2D Gaussian Splatting for Geometrically Accurate Radiance Fields, SIGGRAPH 2024. [Paper | Project | Code] -
Deblur-GS: 3D Gaussian Splatting from Camera Motion Blurred Images, I3D 2024. [Paper | Code]
-
GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting, [Paper | Code]
-
DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark, [Paper | Project]
-
GaussianPro: 3D Gaussian Splatting with Progressive Propagation, ICML 2024. [Paper | Project]
-
VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality, [Paper | Project]
-
MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Images, ECCV2024. [Paper | Project]
-
DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting, [Paper | Project]
-
COLMAP-Free 3D Gaussian Splatting, CVPR2024. [Paper | Project | Code]
-
FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization, CVPR 2024. [Paper | Project]
-
GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting, CVPR 2024. [Project]
-
LangSplat: 3D Language Gaussian Splatting, CVPR 2024 (Highlight). [Project | Code]
-
SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering, CVPR 2024.
-
GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces, CVPR 2024. [Project | Code]
-
pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction, CVPR 2024.
-
Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers, CVPR 2024. [Project | Code]
-
GS-IR: 3D Gaussian Splatting for Inverse Rendering, CVPR 2024. [Project | Code]
-
GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis, CVPR 2024. [Project | Code]
-
Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Video, 2024. [Paper | Project]
-
GaussMR: Interactive Gaussian Splatting Sandbox with GPU Particles and Signed Distance Fields, SIGGRAPH 2024. [Paper]
-
MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo, ECCV 2024. [Project | Code]
-
Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Image, CVPRW 2024 (3DMV). [Project | Code]
-
Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splatting, 2024. [Project | Code]
-
Deblurring 3D Gaussian Splatting, ECCV 2024. [Project | Code]
-
bsGS: Recovering Fine Details for 3D Gaussian Splatting, ACM MM 2024. Code
-
GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting, 2024. [Project]
-
WildGaussians: 3D Gaussian Splatting in the Wild, 2024. [Project]
-
Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collections, 2024. [Project | Code]
-
On Scaling Up 3D Gaussian Splatting Training, 2024. [Project | Code]
Literature Review
- Recent advances in 3D Gaussian splatting, Computational Visual Media, 2024. [Paper]
- 3D Gaussian Splatting as New Era: A Survey, IEEE Transactions on Visualization and Computer Graphics, 2024. [Paper]
- Gaussian Splatting: 3D Reconstruction and Novel View Synthesis: A Review, IEEE Access, 2024. [Paper]
NeRF (Improving speed & efficiency)
- How Far Can We Compress Instant-NGP-Based NeRF? CVPR 2024. [Project | code]
- FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices With a Simple Super-Resolution Pipeline, WACV 2024. [Paper]
- HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfaces, CVPR 2024. Project
- Shape of Motion: 4D Reconstruction from a Single Video, 2024. [Project | Code]
- MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds, 2024. Project
- Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videos, 2024.
- CoGS : Controllable Gaussian Splatting, CVPR 2024. [Project | Code]
LLM & 3D
- Comp4D: LLM-Guided Compositional 4D Scene Generation, [Paper | Project]
- GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guidedGenerative Gaussian Splatting, [Paper | Project]
SLAM & Sensor Fusion
- Gaussian Splatting SLAM, CVPR 2024 [Paper | Code]
- SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM, CVPR 2024. [Paper | Code]
- RGBD GS-ICP SLAM, [Paper | Code]
- Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting, [Paper | Code]
- Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Cameras, [Paper | Code]
Compression & Efficiency
- GaussianPro: 3D Gaussian Splatting with Progressive Propagation, [Paper | Code]
- InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 10 Seconds, [Paper
- HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression, [Paper | Code]
- Reducing the Memory Footprint of 3D Gaussian Splatting, [Paper | Project]
- SUNDAE: Spectrally Pruned Gaussian Fields with Neural Compensation, [Paper | Code]
- Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesis, CVPR 2024. [Project | Code]
Speed & Efficiency
[+]LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS, 2023. [Paper | Code][+]SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering, 2023. [Paper | Code]- Compact 3D Gaussian Representation for Radiance Field, [Paper | Code]
- Compact3D: Compressing Gaussian Splat Radiance Field Models with Vector Quantization, [Paper | Code]
Quality
- Mip-Splatting: Alias-free 3D Gaussian Splatting, [Paper | Code]
- Multi-Scale 3D Gaussian Splatting for Anti-Aliased Rendering, [Paper | Code]
- FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Information, Paper
- COLMAP-Free 3D Gaussian Splatting, [Paper | Project]
- NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance, Paper
- Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images, Paper
- GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting, Paper
Reflection & Relighting
- GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces, [Paper | Code]
- Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing, Paper
Others
- Splatter Image: Ultra-Fast Single-View 3D Reconstruction, [Paper | Code]
- pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction, [Paper | Project Page]
- Volume Feature Rendering for Fast Neural Radiance Field Reconstruction, NeurIPS 2023.
[+]4D Gaussian Splatting for Real-Time Dynamic Scene Rendering, [Paper | Project Page | Code |[+]4K4D: Real-Time 4D View Synthesis at 4K Resolution. [Paper | Project Page | Code (Inference)]]- Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis, [Paper | Project Page | Code | Explanation Video]
- Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction, [Paper | Project Page | Code]
- Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting, Paper
- GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis, Project Page
Papers with shared code are ranked higher in this list
- DreamGaussian4D: Generative 4D Gaussian Splatting, [Paper | Code]
- Text-to-3D using Gaussian Splatting, [📄 Paper | Project Page | Code | Explanation Video]
- DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation, Paper | Project Page | Code | Explanation Video]
- GaussianDreamer: Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors, [Paper | Project Page | Code]
- Gsgen: Text-to-3D using Gaussian Splatting, [Paper | Project Page | Code]
- LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes, [Paper | Project Page]
- PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics, [Paper | Project Page]
- HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting, [Paper]
- Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting, [Paper | Code]
- Gaussian Shell Maps for Efficient 3D Human Generation, [Paper | Code]
- GauHuman: Articulated Gaussian Splatting from Monocular Human Videos, [Paper | Project Page | Code]
- HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting, Paper
- HUGS: Human Gaussian Splats, Paper
- SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videos, Paper
- Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling, Paper
- Human101: Training 100+FPS Human Gaussians in 100s from 1 View, Paper
- Deformable 3D Gaussian Splatting for Animatable Human Avatars, Paper
- LangSplat: 3D Language Gaussian Splatting, [Paper | Project Page | Code]