I saw a Santa dancing video today and the suspension of disbelief was almost instantly dispelled when the cuffs of his jacket moved erratically. The GenAI was trying to get them to sway with arm movements but because it didn't understand why they would sway it just generated a statistical approximation of swaying.
GenAI also definitely doesn't understand 3D structures easily demonstrated by completely incorrect morphological features. Even my dogs understand gravity, if I drop an object they're tracking (food) they know it should hit the ground. They also understand 3D space, if they stand on their back legs they can see over things or get a better perspective.
I've yet to see any GenAI that demonstrates even my dogs' level of understanding the physical world. This leaves their output in the uncanny valley.
We would love to learn more about the origin of your certainty.
Fascinating! I wish I had the knowledge and wherewithal to do that and become rich instead of wasting my time on HN.
Neural networks are largely black box piles of linear algebra which are massaged to minimize a loss function.
How would you incorporate smooth kinematic motion in such an environment?
The fact that you discount the knowledge of literally every single employee at OpenAI is a big signal that you have no idea what you’re talking about.
I don’t even really like OpenAI and I can see that.
I have been working with NLP and neural networks since 2017.
They aren’t just black boxes, they are _largely_ black boxes.
When training an NN, you don’t have great control over what parts of the model does what or how.
Now instead of trying to discredit me, would you mind answering my question? Especially since, as you say, the theory is so simple.
How would you incorporate smooth kinematic motion in such an environment?
You’ve convinced me that you’re small and know very little about the subject matter.
You don’t need to reply to this. I’m done with this convo.
Do you know anyone or any companies working on that?
To that end, it is actually extremely important to nit-pick this stuff. For those of us using these tools, we need to be able to talk shop about which ones are keeping up, which are work like shit in practice, and which ones work but only in certain situations, and which situations those are.
Especially anything involving fluid/smoke dynamics, or fast dynamic momements of humans and animals all suffer from the same weird motion artifacts. I can't describe it other than that the fluidity of the movements are completely off.
And as all genai video tools I've used are suffering from the same problem, I wonder if this is somehow inherent to the approach & somehow unsolvable with the current model architectures.