Re:Cognitive Behaviors That Enable Self-Improving Reasoners
by thesz on Thursday March 06, 2025 @06:14AM
(#43278823)
Exam is interpolation.
Research is extrapolation.
Neural networks are interpolators, they are notoriously bad at extrapolation. For simple example, look at pendigits data set [1]. The test part of pendigits is taken from different "writers" than train part and neural networks aren't that good at it.
Research is extrapolation.
Neural networks are interpolators, they are notoriously bad at extrapolation. For simple example, look at pendigits data set [1]. The test part of pendigits is taken from different "writers" than train part and neural networks aren't that good at it.
[1] https://archive.ics.uci.edu/dataset/81/pen+based+recognition...
Humans do extrapolation all the time.