Re:The "it" in AI models is the dataset
by HarHarVeryFunny on Thursday April 25, 2024 @09:36AM
(#40157400)
Not sure about feasible, but certainly not efficient.
I think this MLP universal approximator notion is similar to a Turing machine being a universal computation device. Correct, but practically useless.
I don't think Sutton's bitter lesson is going to result in everything being an MLP. You want the most scalable architecture, which an MLP certainly is not.
I think this MLP universal approximator notion is similar to a Turing machine being a universal computation device. Correct, but practically useless.
I don't think Sutton's bitter lesson is going to result in everything being an MLP. You want the most scalable architecture, which an MLP certainly is not.