News for hackers. Stuff that matters.
Re:Cognitive Behaviors That Enable Self-Improving Reasoners by thesz on Thursday March 06, 2025 @06:14AM (#43278823)
Exam is interpolation.

Research is extrapolation.

Neural networks are interpolators, they are notoriously bad at extrapolation. For simple example, look at pendigits data set [1]. The test part of pendigits is taken from different "writers" than train part and neural networks aren't that good at it.

[1] https://archive.ics.uci.edu/dataset/81/pen+based+recognition...

Humans do extrapolation all the time.

There are no comments on this comment yet.