I actually stumbled across this paper while researching exactly that question! A reliable method for transforming gaussians into geometry seems like it could dramatically change the gamedev asset pipeline.
I agree! Also I think it could open up entire new types of games.
Re:Gaussian Splatting Slam [CVPR 2024]
by algebra-pretext on Monday August 12, 2024 @07:43PM
(#41230619)
Not using SLAM like this paper and not transforming splats into polygonal meshes, but I used Luma's Unreal Engine plugin[0] for rendering splats via Niagara VFX to develop a walkable reconstruction of a small mall in my hometown[1]. I believe RealityCapture and Nerfstudio have some built-in abilities to transform splats to meshes but haven't seen good results; you're better off feeding the raw image data into a reconstruction workflow focused on polygonal meshes which is RealityCapture's main feature[2]. They recently got bought out by Epic (creator of Unreal Engine) and photogrammetry is already used everywhere in video games, one recent standout example being Hellblade II: Senua's Saga.
[0]: https://www.unrealengine.com/marketplace/en-US/product/luma-...
Are there any examples or algorithms that can turn this into 3D objects that could be used in a video game? Any examples of someone doing that?