Re:Video generation models as world simulators
by chkaloon on Thursday February 15, 2024 @11:17PM
(#39393094)
I've also noticed on some of the featured videos that there are some perspective/parallax errors. The human subjects in some are either oversized compared to background people, or they end up on horizontal planes that don't line up properly. It's actually a bit vertigo-inducing! It is still very remarkable
Re:Video generation models as world simulators
by mr_toad on Thursday February 15, 2024 @11:01PM
(#39393034)
> For example, the surfer is surfing in the air at the end
Maybe it’s been watching snowboarding videos and doesn’t quite understand the difference.
Re:Video generation models as world simulators
by sega_sai on Thursday February 15, 2024 @09:22PM
(#39392343)
That is creepy...
Re:Video generation models as world simulators
by SiempreViernes on Friday February 16, 2024 @06:15AM
(#39395530)
Take a look at these adorable kangaroos to relax:
https://cdn.openai.com/tmp/s/an-adorable-kangaroo-wearing-bl...
https://cdn.openai.com/tmp/s/an-adorable-kangaroo-wearing-a-...
Re:Video generation models as world simulators
by sho_hn on Friday February 16, 2024 @09:29AM
(#39397483)
Is the guy with the arm sticking out of his shoulder the relaxing part? :-)
Re:Video generation models as world simulators
by SushiHippie on Friday February 16, 2024 @11:31AM
(#39399227)
I think you forgot the most adorable one /s
https://cdn.openai.com/tmp/s/an-adorable-kangaroo-wearing-bl...
no but for real this seems to be the most "adorable" one:
https://cdn.openai.com/tmp/s/an-adorable-kangaroo-wearing-bl...
Re:Video generation models as world simulators
by coffeebeqn on Thursday February 15, 2024 @09:19PM
(#39392317)
The hyper realistic and plausible movement of the glass breaking makes this bizarrely fascinating. And it doesn’t give me the feeling of disgust the motion in the more primitive AI models did
Re:Video generation models as world simulators
by danans on Friday February 16, 2024 @01:44AM
(#39393974)
> Or wherever this map is coming from:
> https://cdn.openai.com/tmp/s/a-woman-wearing-purple-overalls...
Notice also that that a roughly 6 seconds there is a third hand putting the map away.
Re:Video generation models as world simulators
by hackerlight on Friday February 16, 2024 @02:57AM
(#39394381)
Where do you find the last two?
Re:Video generation models as world simulators
by SushiHippie on Friday February 16, 2024 @08:21AM
(#39396621)
Part of this website changes after the video finished and switches to the next video. There is no way to control it. These are both "X wearing Y taking a pleasant stroll in Z during W"
Re:Video generation models as world simulators
by SushiHippie on Friday February 16, 2024 @11:30AM
(#39399209)
nvm you can control it, when you click on the variables, there is a dropdown to select values for the variables.
Re:Video generation models as world simulators
by SiempreViernes on Friday February 16, 2024 @05:53AM
(#39395401)
> Or the way this person walks:
> https://cdn.openai.com/tmp/s/a-woman-wearing-a-green-dress-a...
Also, why does she have a umbrella sticking out from her lower back?
Re:Video generation models as world simulators
by zenon on Friday February 16, 2024 @06:14AM
(#39395527)
I suppose the lady usually has an umbrella in this kind of situation, so it felt the umbrella should be included in some way: https://youtu.be/492tGcBP568
Re:Video generation models as world simulators
by YeGoblynQueenne on Friday February 16, 2024 @10:53AM
(#39398614)
In truth, that's not a woman in a green dress, it's a bunch of penguins disguised as a woman in a green dress. That explains the gait. As to the umbrella, they assumed that humans, intelligent as we are, always carry polar bear protection around.
For example, the surfer is surfing in the air at the end:
https://cdn.openai.com/tmp/s/prompting_7.mp4
Or this "breaking" glass that does not break, but spills liquid in some weird way:
https://cdn.openai.com/tmp/s/discussion_0.mp4
Or the way this person walks:
https://cdn.openai.com/tmp/s/a-woman-wearing-a-green-dress-a...
Or wherever this map is coming from:
https://cdn.openai.com/tmp/s/a-woman-wearing-purple-overalls...