Re:Input to GPT Matters a Lot
by SketchySeaBeast on Monday April 03, 2023 @11:18AM
(#35425153)
All of them, all the time? Assuming it does fail does it have sound reasoning, or is it nonsense?
[ Parent
| on HN ]
It doesn't have to be perfect. What generally matters is its performance relative to various human populations.
Probably in between.
The point of my comment is that depending on how you interpret the description "predicts the next token", something that can do this well enough should be superhumanly clever. The task is "AI Complete".
Don't misinterpret me as saying that GPT is superhumanly clever. I'm just saying that something that's sufficiently good at what people think GPT is doing, should be superhuman.
Do humans have sound reasoning?
They have the capacity for it, despite rarely exercising it.
Re:Input to GPT Matters a Lot
by SketchySeaBeast on Monday April 03, 2023 @11:45AM
(#35425743)
Sometimes. Sometimes they'll come up with entirely novel ways to think through a problem that pushes knowledge forward. Do we have any examples of ChatGPT showing any such capacity?