Re:Stability.ai – Introducing Stable Video 3D
by euazOn on Monday March 18, 2024 @06:53PM
(#39751029)
Therefore, what is the main usecase of this model? Generating cheap 3D assets for videogames?
[ Parent
| on HN ]
Re:Stability.ai – Introducing Stable Video 3D
by jsheard on Monday March 18, 2024 @07:10PM
(#39751157)
I don't think they have a specific use-case for this model, they're throwing ideas at the wall again in the hopes some of them stick and eventually turn into another product. The paper doesn't discuss any of the problems that would need to be solved in order to easily generate game-ready assets so I think it's safe to assume that it currently doesn't.
For games at the very least you need to consider polygon budget, getting reasonably good UVs, and generating materials which fit into a PBR shader pipeline, at least if it's going to work with rendering pipelines as we know them today (as opposed to rendering neural representations directly, which is a thing people are trying to do but is totally unproven in production).
Re:Stability.ai – Introducing Stable Video 3D
by pksebben on Monday March 18, 2024 @11:30PM
(#39752678)
I'd be willing to bet you could create a diffusion model to map unrefined meshes to UV-fixed and remeshed surfaces. If you had a large enough library of good meshes you just programmatically mess 'em up and use that as the dataset.