News for hackers. Stuff that matters.
Re:Why is it important for a matrix to be square? (2018) by blt on Sunday June 21, 2020 @06:52PM (#23595989)
I would not call the SVD an "extension" of the eigen decomposition. The SVD is also defined for square matrices and is not equal to the eigen decomposition except for the case of symmetric matrices.

This leads to the question: for a non-symmetric square diagonalizable matrix, what is the difference between the eigenvalues and the singular values? A good heuristic for applications is that the eigenvalues capture the asymptotic behavior of repeating the map, i.e. the behavior of A^k as k goes to infinity, while the singular values capture the transient behavior of applying the map once.

For example, consider the matrix

     0.9   x
     0   0.9.
As x goes to infinity, its largest singular value becomes infinity, while its eigenvalues remain smaller than one. This means that there exists a vector (0 1) whose image under A is huge, but whose image under A^k still approaches the zero vector for large k.

A good book on these topics is "Spectra and Pseudospectra" by Trefethen and Embree.

Re:Why is it important for a matrix to be square? (2018) by solinent on Sunday June 21, 2020 @07:07PM (#23596072)
Good point, while I don't need this clarification others might. I shouldn't have implied that they are the same for square matrices implicitly, hence my failed attempt at using "similar".

However, they're still an extension in the sense that singular values do correspond to (square of the) eigenvalues of the square matrix A A^T and A^T A.

Re:Why is it important for a matrix to be square? (2018) by blt on Sunday June 21, 2020 @07:35PM (#23596202)
Yeah I guess "extension" is not a precisely defined word. I wanted to make sure other readers didn't interpret like "generalization", meaning that the original narrow concept is precisely a special case of the extension.
Re:Why is it important for a matrix to be square? (2018) by solinent on Sunday June 21, 2020 @09:24PM (#23596686)
Yeah, I wouldn't have used extension for a math audience, probably just "related concept", or "application of". In the software context it usually means the opposite--something specific that makes use of some existing functionality.