News for hackers. Stuff that matters.
Re:Video generation models as world simulators by SushiHippie on Thursday February 15, 2024 @08:43PM (#39392015)
I like that this one shows some "fails", and not just the top of the top results:

For example, the surfer is surfing in the air at the end:

https://cdn.openai.com/tmp/s/prompting_7.mp4

Or this "breaking" glass that does not break, but spills liquid in some weird way:

https://cdn.openai.com/tmp/s/discussion_0.mp4

Or the way this person walks:

https://cdn.openai.com/tmp/s/a-woman-wearing-a-green-dress-a...

Or wherever this map is coming from:

https://cdn.openai.com/tmp/s/a-woman-wearing-purple-overalls...

Re:Video generation models as world simulators by chkaloon on Thursday February 15, 2024 @11:17PM (#39393094)
I've also noticed on some of the featured videos that there are some perspective/parallax errors. The human subjects in some are either oversized compared to background people, or they end up on horizontal planes that don't line up properly. It's actually a bit vertigo-inducing! It is still very remarkable
Re:Video generation models as world simulators by mr_toad on Thursday February 15, 2024 @11:01PM (#39393034)
> For example, the surfer is surfing in the air at the end

Maybe it’s been watching snowboarding videos and doesn’t quite understand the difference.

Re:Video generation models as world simulators by sega_sai on Thursday February 15, 2024 @09:22PM (#39392343)
That is creepy...
Re:Video generation models as world simulators by SiempreViernes on Friday February 16, 2024 @06:15AM (#39395530)
Re:Video generation models as world simulators by sho_hn on Friday February 16, 2024 @09:29AM (#39397483)
Is the guy with the arm sticking out of his shoulder the relaxing part? :-)
Re:Video generation models as world simulators by SushiHippie on Friday February 16, 2024 @11:31AM (#39399227)
I think you forgot the most adorable one /s

https://cdn.openai.com/tmp/s/an-adorable-kangaroo-wearing-bl...

no but for real this seems to be the most "adorable" one:

https://cdn.openai.com/tmp/s/an-adorable-kangaroo-wearing-bl...

Re:Video generation models as world simulators by coffeebeqn on Thursday February 15, 2024 @09:19PM (#39392317)
The hyper realistic and plausible movement of the glass breaking makes this bizarrely fascinating. And it doesn’t give me the feeling of disgust the motion in the more primitive AI models did
Re:Video generation models as world simulators by danans on Friday February 16, 2024 @01:44AM (#39393974)
> Or wherever this map is coming from:

> https://cdn.openai.com/tmp/s/a-woman-wearing-purple-overalls...

Notice also that that a roughly 6 seconds there is a third hand putting the map away.

Re:Video generation models as world simulators by hackerlight on Friday February 16, 2024 @02:57AM (#39394381)
Where do you find the last two?
Re:Video generation models as world simulators by SushiHippie on Friday February 16, 2024 @08:21AM (#39396621)
Part of this website changes after the video finished and switches to the next video. There is no way to control it. These are both "X wearing Y taking a pleasant stroll in Z during W"
Re:Video generation models as world simulators by SushiHippie on Friday February 16, 2024 @11:30AM (#39399209)
nvm you can control it, when you click on the variables, there is a dropdown to select values for the variables.
Re:Video generation models as world simulators by SiempreViernes on Friday February 16, 2024 @05:53AM (#39395401)
> Or the way this person walks:

> https://cdn.openai.com/tmp/s/a-woman-wearing-a-green-dress-a...

Also, why does she have a umbrella sticking out from her lower back?

Re:Video generation models as world simulators by zenon on Friday February 16, 2024 @06:14AM (#39395527)
I suppose the lady usually has an umbrella in this kind of situation, so it felt the umbrella should be included in some way: https://youtu.be/492tGcBP568
Re:Video generation models as world simulators by YeGoblynQueenne on Friday February 16, 2024 @10:53AM (#39398614)
In truth, that's not a woman in a green dress, it's a bunch of penguins disguised as a woman in a green dress. That explains the gait. As to the umbrella, they assumed that humans, intelligent as we are, always carry polar bear protection around.