News for hackers. Stuff that matters.

A comment on Input to GPT Matters a Lot. Parent comment

Re:Input to GPT Matters a Lot by skybrian on Monday April 03, 2023 @11:47AM (#35425782)
You’ve attached to a superficial explanation that doesn’t explain the magic trick. It sometimes emits text that corresponds to how people reason, but it’s unclear how well its mechanisms generalize because we don’t know what they are.

We should be curious about how it does what it does when it seems to be reasoning.

More: https://skybrian.substack.com/p/dont-settle-for-a-superficia...

[ Parent | on HN ]
Re:Input to GPT Matters a Lot by tomrod on Monday April 03, 2023 @11:50AM (#35425845)
> Since most of us aren’t AI researchers, what does “not settling” mean in practice? We should remember that there are mysteries and reject superficial explanations. Chatbot boosters will promote them and skeptics will dismiss them, but that doesn’t mean they understand how they work.

God of the gaps, reworked. Admittedly, a new claim to me. $10.05.

[ Parent | on HN ]
Re:Input to GPT Matters a Lot by skybrian on Monday April 03, 2023 @12:53PM (#35427207)
When you want to pretend that an open research question isn’t interesting, I guess dismissing it as “God of the gaps” would be one way to do that.
[ Parent | on HN ]