derivadas.dev

Pablo Díaz Viñambres

MSc Informatics @ TUM

GeMS: Geometry-aware Mesh Splatting

PyTorchCUDAGaussian SplattingResearch


GeMS (Geometry-aware Mesh Splatting) was my final project for the Machine Learning for 3D Geometry (ML3D) course taught by Prof. Angela Dai at TUM, done together with Shao Jie Hu-Chen. We build on a CVPR 2026 paper, MeshSplatting, which replaces the Gaussian primitives found in standard 3D Gaussian Splatting with an explicit, opaque triangle soup representation, which is later triangulated into a mesh. While the approach is interesting and yields decent photometric quality, it usually produces noisy and broken geometry on simple planar regions such as walls and floors. GeMS attempts to reduce these effects, caused by the underconstrained photometric objective, by adding three regularization terms Llap,Lplanar,Lshared\mathcal{L}_{\text{lap}}, \mathcal{L}_{\text{planar}}, \mathcal{L}_{\text{shared}} on top of the photometric loss during training: a Laplacian smoothness + normal-consistency term that dampens vertex noise and folding, a plane-alignment loss (cosine-alignment with normal + L1 with center) which uses an optimized representation provided by PlanarSplatting, and a semantic-boundary loss that discourages triangles from being shared between two different objects.

GeMS pipeline overview, from planar detection to the final mesh

On Mip-NeRF360 and ScanNet++, GeMS clearly improves geometric quality, with Chamfer-L1, F-score and normal consistency all improving, while keeping photometric quality on par with or better than the baseline. It also decreases the fraction of ambiguous triangles shared between object instances (12.33% down to 10.33% on our ScanNet++ subset). The plane alignment component (Lplanar\mathcal{L}_{\text{planar}}) turned out to be the single strongest component of our method:

MethodPSNR↑Chamfer-L1↓F-score↑Shared Tri.↓
MeshSplatting19.630.1100.54012.33%
+ Lgeo\mathcal{L}_{\text{geo}}19.720.0680.58811.29%
+ Lplanar\mathcal{L}_{\text{planar}}20.590.0560.62912.85%
+ Lshared\mathcal{L}_{\text{shared}}20.540.0680.57112.98%
GeMS (Ours)19.9950.0620.63010.33%
Qualitative comparison of RGB renders and normal maps across ablations against the baseline and ground truth