Re:Capabilities of GPT-4 on Medical Challenge Problems
by EGreg on Sunday March 26, 2023 @07:39PM
(#35320935)
I think it's "top-down reasoning"
It does in fact create some sort of model out of those billions of dimensions, and it's able to re-use it across many different fields, too
It's not "bottom-up reasoning" so it misses a bunch of little details.
Basically AI is a search through a vast space, and most of the approaches have focused on top-down search. Reasoning bottom-up is what AlphaBeta search did (rybka and all those other chess programs, that calculated all possible combinations 10 moves ahead). Those missed some of the "top-down positional" stuff, whereas AlphaGo missed some weird-ass edge cases
It does in fact create some sort of model out of those billions of dimensions, and it's able to re-use it across many different fields, too
It's not "bottom-up reasoning" so it misses a bunch of little details.
Basically AI is a search through a vast space, and most of the approaches have focused on top-down search. Reasoning bottom-up is what AlphaBeta search did (rybka and all those other chess programs, that calculated all possible combinations 10 moves ahead). Those missed some of the "top-down positional" stuff, whereas AlphaGo missed some weird-ass edge cases
https://www.engadget.com/alphago-pushed-human-go-players-to-...
But it is a sort of intelligence. Just not one you can trust when details matter. You can use it for pretty pictures for now, and essays.
Generative AI is not deep but extremely broad. It knows many subjects. And can discuss more than any specific person.
But guess who produced all that content for it and made it publicly available. Humans!
(And in cases where it wasn't publicly available, I guess they can sue the company)