Re:An overview of the theory of overparameterized machine le...
by joe_the_user on Tuesday September 21, 2021 @08:52PM
(#28611924)
Memorization is only an issue if you allow it to be.
Sure, it's a potential problem that can appear in the process implementing a deep learning solution. It's not an insurmountable problem. But the fact that still appears seems like an indication the situation in deep learning is more complicated than "overparameterization is not a problem".
Sure, it's a potential problem that can appear in the process implementing a deep learning solution. It's not an insurmountable problem. But the fact that still appears seems like an indication the situation in deep learning is more complicated than "overparameterization is not a problem".