Re:Do Machine Learning Models Memorize or Generalize?
by NovaDudely on Thursday August 10, 2023 @08:58PM
(#37083823)
This was the thinking I was taking. It is a useful tool at first but taken too far can be a bad thing in some situations.
this 'compression' is what 'understanding' something really entails; at first... but then there's more.
when knowledge becomes understood it enables perception (e.g. we perceive meaning in words once we learn to read).
when we get really good at this understanding-perception we may start to 'manipulate' the abstractions we 'perceive'. an example would be to 'understand a cube' and then being able to rotate it around so to predict what would happen without really needing the cube. but this is an overly simplistic example