Re:The Computer Scientist Peering Inside AI’s Black Boxes
by bane on Tuesday May 02, 2023 @12:12AM
(#35783277)
> the same way that quantum physics doesn’t give much insight into biology
This is very insightful. I've long maintained that "understanding" requires some predictive ability in addition to an ability to explain what's happened in the past.
In the case of neural networks, we should be able to "simply" generate the network that has the desired behavior.
But we can't. We're still shackled to compiling some collection of training data that may or may not produce the desired behavior, tested by some other collection of testing data that may or may not test the desired phenomenon.
This is very insightful. I've long maintained that "understanding" requires some predictive ability in addition to an ability to explain what's happened in the past.
In the case of neural networks, we should be able to "simply" generate the network that has the desired behavior.
But we can't. We're still shackled to compiling some collection of training data that may or may not produce the desired behavior, tested by some other collection of testing data that may or may not test the desired phenomenon.