News for hackers. Stuff that matters.
Re:Sora: Creating video from text by gwern on Thursday February 15, 2024 @03:22PM (#39388223)
Yes, the 'special effects' effect will kick in. Within a year or so, you'll spot this easily, quite aside from the more obvious issues. (That Landrover captioned 'DANDOVER' - is this still using BPEs?!)

Aside from visual plausibility, there's also the issue of physics: one of the things you would like to use video models for is understanding real-world physics and cause-and-effect for planning or learning _in silico_. Something may look good but get key physics wrong and be useless for, say, robotics.

There are no comments on this comment yet.