News for hackers. Stuff that matters.
Re:Eigenvectors and Eigenvalues (2015) by soVeryTired on Tuesday May 15, 2018 @12:22PM (#17075126)
For a large fraction of probability theory, you only need two main facts from linear algebra.

First, linear transforms map spheres to ellipsoids. The axes of the ellipsoid are the eigenvectors.

Second, linear transforms map (hyper) cubes to parallelpipeds. If you start with a unit cube, the volume of the parallelpiped is the determinant of the transform.

That more or less covers covariances, PCA, and change of variables. Whenever I try to understand or re-derive a fact in probability, I almost always end up back at one or the other fact.

They're also useful in multivariate calculus, which is really just stitched-together linear algebra.

Re:Eigenvectors and Eigenvalues (2015) by qmalzp on Tuesday May 15, 2018 @03:54PM (#17077267)
I think the first point is only true for symmetric matrices (which includes those that show up in multivariable calc). In general, the eigenvectors need not be orthogonal.
Re:Eigenvectors and Eigenvalues (2015) by soVeryTired on Tuesday May 15, 2018 @05:35PM (#17078066)
Yep, you could well be right. The image of an ellipse under a linear transform is definitely an ellipse, but I'm not sure about the eigenvectors in the general case.

The symmetric case is by far the most relevant for probability theory though.

Re:Eigenvectors and Eigenvalues (2015) by tprice7 on Tuesday May 15, 2018 @11:36PM (#17079845)
In general it's the eigenvectors of the positive-semidefinite (hence symmetric) part of the left polar decomposition.
Re:Eigenvectors and Eigenvalues (2015) by zawerf on Tuesday May 15, 2018 @03:33PM (#17077060)
I use the 2nd point a lot for debugging 3d transforms. To expand upon it, for example in three dimensions the three axes are:

(1, 0, 0)

(0, 1, 0)

(0, 0, 1)

To find out where those axes are after a 3x3 matrix transform, you just read off the first, second, and third columns of the matrix respectively. Then you can mentally visualize another unit cube in the new coordinate system using those three vectors as the edges of the cube.

Really basic change-of-basis stuff but academic lectures don't emphasize how useful it is to be able to look at a matrix of numbers immediately know what it does.

Re:Eigenvectors and Eigenvalues (2015) by aidos on Tuesday May 15, 2018 @06:11PM (#17078360)
This concept totally changed my intuitive understanding of matrices. Beautifully illustrated in the below 3blue1brown video.

https://youtu.be/kYB8IZa5AuE?t=3m15s

Re:Eigenvectors and Eigenvalues (2015) by sakuronto on Tuesday May 15, 2018 @01:21PM (#17075672)
Not a very useful addition but hypercube is to cube as parallelotope is to parallelepiped.