Re:I asked GPT-3 for the question to “42”
by AnIdiotOnTheNet on Wednesday November 25, 2020 @10:54AM
(#25210509)
There have been studies to indicate we can predict which decisions people will make before they themselves are consciously aware they have made a decision. I'm not convinced "we can inspect what's going on" is sufficient criteria for ruling out intelligence.
You realise we have debugging tools that let us inspect what is going on inside transformer-based models like GPT-3 right?
> why do we train a system that is supposed to be intelligent on such data?
Because it's available and does interesting things.
> we cannot really tell whether it is really dumb or just playing dumb for the above reason.
No one who works in the field thinks anything approaching this.
I think GPT-3 does raise questions about what intelligence is though.