Thanks for this insight! Can you also suggest a book or other materials that I can read to understand this in greater depth?
perhaps the most important continuous distribution family because of the Central Limit Theorem
instead of
perhaps the most continuous distribution family because of the Central Limit Theorem
As for a single book, not really. See my response to the sibling comment for some more insight.
You are right that the normal distribution is not continuous because of the CLT. That was a typo. I meant "most important continuous" distribution.
Yes, other exponential distributions are convenient to work with, but the Gaussian maximum-likelihood estimate has a closed-form expression defined with just linear algebra. That's really damn nice in my opinion.
The point is that distance (in most real-world applications) is equivalent to the length of the hypotenuse of a right triangle in Euclidean space. So in my opinion, yes, high-school trigonometry governs a lot of advanced mathematics, including in statistics and machine learning.
Call it numerology if you want, I'm just trying to get people excited about math here.
Basically, everything boils down to high-school trigonometry, because it's the most natural way to define distances in our world. I still marvel at it.