Re:Ask HN: What mental models do you use everyday?
by RhysU on Sunday November 21, 2021 @02:56PM
(#29299147)
These relate to physics/modeling. I am going to hand wave a bunch.
If a system has to operate the same way under rotation/reflection, that strongly constrains what the system can be doing. Think crystals or isotropic forces or, in the day job, what should happen if you negate a feature going into a neutral network then retrain. Should it matter from which perspective you look at a thing?
If a system is continuous then smooth changes to inputs should cause smooth changes to outputs. The system probably will be robust to small perturbations because they will result in small output changes.
If a system has to operate the same way under rotation/reflection, that strongly constrains what the system can be doing. Think crystals or isotropic forces or, in the day job, what should happen if you negate a feature going into a neutral network then retrain. Should it matter from which perspective you look at a thing?
If a system is continuous then smooth changes to inputs should cause smooth changes to outputs. The system probably will be robust to small perturbations because they will result in small output changes.
https://en.m.wikipedia.org/wiki/Turbulence#Kolmogorov.27s_th... is something of an example.