News for hackers. Stuff that matters.

A comment on "Building Machines That Learn and Think Like People", 7 Years Later. Parent comment

Re:"Building Machines That Learn and Think Like People", 7 Y... by polygamous_bat on Sunday October 15, 2023 @07:12PM (#37894259)
> Could GPT-4V be used for robotic applications?

I have a quote I like in this context, “Could you learn gymnastics just from watching videos?” However intelligent an internet trained model may be, I strongly believe you have to have some interaction with the real world to learn more complicated actions. So far, Pick and place, is all that’s been shown with the bigger models, so my hypothesis seems to be holding for now.

[ Parent | on HN ]
Re:"Building Machines That Learn and Think Like People", 7 Y... by og_kalu on Sunday October 15, 2023 @08:37PM (#37894724)
Pick and place isn't all you can do by any stretch.

https://general-pattern-machines.github.io/

https://wayve.ai/thinking/lingo-natural-language-autonomous-...

It's just the straightforward application.

>I have a quote I like in this context, “Could you learn gymnastics just from watching videos?”

People seem to have this weird idea that language models learn by some sort of magic osmosis. They're not just "reading" text or "watching" images. They learn by predicting, failing and adjusting neurons based on the data. Text is their world and they are interacting with it.

[ Parent | on HN ]