Re:ML on Apple ][+
by have-a-break on Monday September 29, 2025 @02:55PM
(#45417400)
Back prop and attention are just extensions of interpolation.
[ Parent
| on HN ]
By that logic it's all "just linear maths".
Back prop requires and limits to analytically differentiable in a normal way.
Attention is... Oh dear comparing linear regression to attention is comparing a diesel jet engine to a horse.
Re:ML on Apple ][+
by aleph_naught on Monday September 29, 2025 @05:11PM
(#45418811)
It's all just a series of S(S(S(....S(0)))) anyways.