News for hackers. Stuff that matters.
Re:Sora: Creating video from text by bamboozled on Friday February 16, 2024 @01:05AM (#39393737)
Wouldn't having a good understanding of physics mean you know that a women doesn't slide down the road when she walks? Wouldn't it know that a woolly mammoth doesn't emit profuse amounts steam when walking on frozen snow? Wouldn't the model know that legs are solid objects in which other object cannot pass through?

Maybe I'm missing the big picture here, but the above and all the weird spatial errors, like miniaturization of people make me think you're wrong.

Clearly the model is an achievement and doing something interesting to produce these videos, and they are pretty cool, but understanding physics seems like quite a stretch?

I also don't really get the excitement about the girl on the train in Tokyo:

In the Tokyo one, the model is smart enough to figure out that on a train, the reflection would be of a passenger, and the passenger has Asian traits since this is Tokyo

I don't know a lot about how this model works personally, but I'm guessing in the training data the vast majority of people riding trains in Tokyo featured asian people in them, assuming this model works on statistics like all of the other models I've seen recently from Open AI, then why is it interesting the girl in the reflection was Asian? Did you not expect that?

Re:Sora: Creating video from text by csomar on Friday February 16, 2024 @03:35AM (#39394611)
> Wouldn't having a good understanding of physics mean you know that a women doesn't slide down the road when she walks? Wouldn't it know that a woolly mammoth doesn't emit profuse amounts steam when walking on frozen snow? Wouldn't the model know that legs are solid objects in which other object cannot pass through?

This just hit me but humans do not have a good understanding of physics; or maybe most of humans have no understanding of physics. We just observe and recognize whether it's familiar or not.

AI will need to be, that being the case, way more powerful than a human mind. Maybe orders of magnitude more "neural networks" than a human brain has.

Re:Sora: Creating video from text by bamboozled on Friday February 16, 2024 @05:16AM (#39395218)
Well we feel the world, it's pretty wild when you think about how much data the body must be receiving and processing constantly.

I was watching my child in the bath the other day, they were having the most incredible time splashing, feeling the water, throwing balls up and down, and yes, they have absolutely no knowledge of "physics" yet navigating and interacting with it as if it was the best thing they've ever done. Not even 12 months old yet.

It was all just happening on feel and yeah, I doubt they could describe how to generate a movie.

Re:Sora: Creating video from text by ehnto on Friday February 16, 2024 @09:56AM (#39397852)
Operating a human takes an incredible intuition of physics, just because you can't write or explain the math doesn't mean your mind doesn't understand it. Further to that, we are able to apply our patterns of physics to novel external situations on the fly sometimes within miliseconds of encountering the situation.

You only need to see a ball bounce once and your brain has done some rough approximations of it's properties and will calc both where it's going and how to get your gangly menagerie pivots, levers, meat servos and sockets to intercept them at just the right time.

Think also about how well people can come to understand the physics of cars and bikes in motorsport and the like. The internal model of a cars suspension in operation is non-trivial but people can put it in their head.

Re:Sora: Creating video from text by nox101 on Friday February 16, 2024 @01:15PM (#39400837)
Humans have an intuitive understanding of physics, not a mathy science one.

I know I can't put my hand through solid objects. I know that if I drop my laptop from chest height it will likely break it, the display will crack or shatter, the case will get a dent. If it hits my foot it will hurt. Depending on the angle it may break a bone. It may even draw blood. All of that is from my intuitive knowledge of physics. No book smarts needed.

Re:Sora: Creating video from text by pera on Friday February 16, 2024 @03:33AM (#39394590)
I agree, to me the most clear example is how the rocks in the sea vanish/transform after the wave: The generated frames are hyperreal for sure, but the represented space looks as consistent as a dream.
Re:Sora: Creating video from text by pests on Friday February 16, 2024 @02:00AM (#39394066)
They could test this by trying to generate the same image but set in New York, etc. I bet it would still be asain.
Re:Sora: Creating video from text by barfingclouds on Friday February 16, 2024 @01:28PM (#39401021)
Give it a year
Re:Sora: Creating video from text by bamboozled on Saturday February 17, 2024 @01:03AM (#39406858)
Ok bro
Re:Sora: Creating video from text by livshitz on Friday February 16, 2024 @06:45PM (#39404576)
The answer could be in between. Who said delusion models are limited to 2d pixel generations?
Re:Sora: Creating video from text by bamboozled on Saturday February 17, 2024 @01:03AM (#39406856)
Did you mean diffusion ?