Re:Do Machine Learning Models Memorize or Generalize?
by tbalsam on Thursday August 10, 2023 @05:15PM
(#37081898)
For more information and the related math behind associative memories, please see Hopfield Neural Networks.
While the upper bound is technically "infinity", there is a tradeoff between the amount of concepts stored and the fundamental amount of information storable per concept, similar to how other tradeoff principles like the uncertainty principle, etc work.
While the upper bound is technically "infinity", there is a tradeoff between the amount of concepts stored and the fundamental amount of information storable per concept, similar to how other tradeoff principles like the uncertainty principle, etc work.