News for hackers. Stuff that matters.
Re:What Is ChatGPT Doing and Why Does It Work? by leereeves on Tuesday February 14, 2023 @08:45PM (#34798986)
> Building a robot arm does help understand how muscles work.

I think we're talking about different levels. A robotic arm helps understand the mechanics of an arm, but not cell metabolism, myosin motors, etc. Any understanding of muscles you might get from a robotic arm is superficial.

> You say that overgrown text prediction isn't how humans work.

To be fair, I did say that, but what I meant was that humans don't work the way ChatGPT does. Maybe we do use "overgrown text prediction" but we don't use word vectors, tensor calculus, and transformers.

We know that humans have some pure text prediction ability. People who've seen Mary Poppins can complete supercalifragili... even though it has no meaning. But how? We don't know, even after building LMs.

> What types of things can't be done with just overgrown text prediction

That's a different claim and not one I'm making. What types of things do humans not do with text prediction? Anything that doesn't involve the language processing parts of the brain, at least.

Re:What Is ChatGPT Doing and Why Does It Work? by IIAOPSW on Wednesday February 15, 2023 @11:40PM (#34815099)
>What types of things do humans not do with text prediction? Anything that doesn't involve the language processing parts of the brain, at least.

Let's separate out the robotics problem from the consciousness problem. Sure the brain solves both, but the things that a computer can't do yet because it has no body aren't fundamental limitations. We can just hook the computer up to a robot body eventually.

So to rephrase, what types of things can the brain of a blind paralyzed person do that text prediction cannot?