AI Will Completely Dominate the Animation Industry in Less Than 5 Years

Re:AI Will Completely Dominate the Animation Industry in Les... by jimmySixDOF on Sunday November 27, 2022 @11:52AM (#33764324)

Neural Radiance Fields (NeRF) alone by themselves will alter VFX fundamentally even without all the Stable Diffusion 2.0 (now with Depth!) etc generation.

NeRF lets you pick ANY smooth camera path in a 3D space built up with nothing more than a mobile phone. That's today.

These two phenomena will start to merge and the impact will be as transformative to the software side of media creation as the switch to digital from celluloid was for hardware. There was a time some still remember when not everyone had a camera in their pocket.

[ Parent | on HN ]

Re:AI Will Completely Dominate the Animation Industry in Les... by startupsfail on Sunday November 27, 2022 @12:11PM (#33764545)

NeRF only works with static scenes, requires perfect camera pose, clean scene with clear edges and low exposure. For outdoors any tree with leaves is going to add a lot of noise and blur. For a natural scene indoors the camera exposure is going to be too high. While it is certainly a breakthrough, even “just” static scene reconstruction is still not solved, given the limitations above.

Note also, NeRF is not an “AI” model, it is more of fancy compact storage for objects, images or scenes.

[ Parent | on HN ]

Re:AI Will Completely Dominate the Animation Industry in Les... by infinityio on Sunday November 27, 2022 @01:04PM (#33765022)

Three years ago, our SOTA image generation models had very strong limitations (when compared to today's models), it can be difficult to see when and where the next breakthroughs will come - NeRFs are not there yet, but we may not be far away

[ Parent | on HN ]

Re:AI Will Completely Dominate the Animation Industry in Les... by htrp on Sunday November 27, 2022 @11:56AM (#33764366)

NeRFs feel like where GAN's were about 3 years ago.

[ Parent | on HN ]