News for hackers. Stuff that matters.
Re:Recent Advances in Natural Language Processing by lmm on Sunday August 16, 2020 @08:35PM (#24182641)
> In this conversation, one of us is thinking far harder than the other. GPT can have conversations like this now, which is impressive. But only I can model the beam, the fall, and the physical reality. When I say "that sounds awful," I actually do a miniature physics simulation in my head, imagining losing my balance and falling off a high beam, landing, the physical pain, etc. GPT does none of that. In either case, when it asks the question or when it answers it, it is entirely ignorant of this sort of "shadow" model that's being constructed.

GPT-3 could presumably write a paragraph like that one. You can claim to have a working physics model in your head, but why should I believe that unless it becomes evident from the things that you communicate to me? I've certainly met humans who could have a superficially legitimate conversation about objects in motion while harbouring enormous misconceptions about the physics involved.

Maybe the biggest takeaway from GPT-3 should be that we should raise our standards for human conversation, demanding more precise language and giving less credit to flourishes that make the meaning ambiguous.

Re:Recent Advances in Natural Language Processing by rland on Sunday August 16, 2020 @09:39PM (#24183008)
I mean the miniature physics simulation of me actually imagining another embodied human falling off of a beam. There is a huge knowledge of the physical world encoded into that. Think about it, you can viscerally imagine balancing on a beam, losing your footing, falling, and the subsequent forces and accelerations on all parts of your body during and after the fall, in real time. All of that information is in our model, and none of it is in GPT's. Everyone has this, it's builtin. I'm not talking about Newton's Laws here.

The physical mechanics of being an embodied thing isn't the only example of this. Any experiential knowledge, any knowledge with feedback suffers from this. And any knowledge that is difficult to put into words, like emotional knowledge, interpersonal knowledge, etc., will be off-limits.

That's my point.

Re:Recent Advances in Natural Language Processing by mercer on Monday August 17, 2020 @06:41AM (#24185905)
While I don't disagree, if I were to have the same conversation I would probably be spending more time thinking about the appropriate response than trying to remember and simulate an experience even remotely similar. So I'd be more like GPT, perhaps?
Re:Recent Advances in Natural Language Processing by akakww on Sunday August 16, 2020 @09:20PM (#24182881)
wow that last point is profound, it would almost solve the problem of misinformation, bogus headlines, double speak, etc. Simply raising the standard for what good speech is.