News for hackers. Stuff that matters.
Re:Experiment: Can 3D improve AI video consistency? by weinzierl on Wednesday February 19, 2025 @09:47AM (#43102676)
It would be surprising if it didn't, but it's a question of diminishing returns.

The complexity and cost likely increase approximately with the third power. Does the result justify this effort?"

Re:Experiment: Can 3D improve AI video consistency? by fabiopolimeni on Wednesday February 19, 2025 @09:59AM (#43102793)
The rationale is when you do not use 3D models to keep subjects consistent over multiple scenes it becomes too unpredictable and you would need way too many trial and errors. 3D helps with it. Then, if you even want to have that very same character starting from a specific pose it will more likely you will give up to the likes of the AI model rather than the other way around.
Re:Experiment: Can 3D improve AI video consistency? by TobiasEnholmX on Wednesday February 19, 2025 @09:55AM (#43102756)
We’re actually finding that leveraging 3D reduces complexity rather than increasing it. Setting up a 3D scene is getting easier with tools like image-to-3D, and once it's set up, you can reuse it flexibly across different shots without having to recreate assets from scratch.

By passing a structured 3D-rendered image to the AI, you increase the chances of the video model generating exactly what you want, rather than relying on unpredictable, frame-by-frame AI improvisation.