The same realization that I don't know linear algebra came when taking a Lie algebras class, and again when learning homological algebra, and probably a few other times as well. There are certainly lots of areas of math that I've never explored that take linear algebra in some other direction (for example, I don't have any idea what the applied math guys do with....).
It's really an amazingly vast subject, especially considering that it's usually just thought of as a tool used to study more advanced topics.
What's really struck me is when I dive into a Wikipedia rabbit hole of linear algebra, following links for terms I don't know. I start on the Topology page, read the introduction section of 10 articles that start with "x is a generalization of y" and somehow end up back on the Topology page. Shallow exposure to the sheer volume and conceptual depth of stuff like topology and algebra has really made me respect modern math.
There have been several times when I've picked up an old math or CS textbook and read something I never really fully understood in college -- it almost instantly makes intuitive sense to me now -- 20 years later.
There's an old saying that college is wasted on the young... in many ways I believe it is true.
I only really started to understand linear algebra when I was forced to in a differential geometry class. The opening chapters were a review intended to fix my university's notoriously broken linear algebra training. As I said, it comes with the territory. You can't design a course based on Halmos' FDVS and expect students coming in, that is, students who've scraped through calculus 1, to manage. So, the recipe book / cookbook style abounds. Granted, there were inklings of mathematics in my linear algebra course. I don't think anyone really appreciated it however. It's hard to grok "vector space over a field" when you've never been introduced to the abstract concept of a field.
When my second year stats lecturer told me that a determinant of a 2x2 matrix was an area, I almost didn't believe him.
Fun exercise I was told about just the other day. Every invertible matrix with integer coefficients has determinant +-1. I would never have known how to solve that after my linear algebra course.
* If M has integer coefficients, then det(M) is an integer. * det(inv(M)) = 1/det(M) * Since M has integer coefficients, det(M) is an integer * Since inv(M) has integer coefficients, det(inv(M)) is an integer * So det(M) and 1/det(M) are both integers, so det(M) is either 1 or -1
LinAlg in college, nothing but a blur of matrices.
Algo trading for work. Now there's a reason to do it, it makes sense.
About SVD, btw, it is another path to PCA, one that solves certain problems that PCA does not.
https://jeremykun.com/2016/04/18/singular-value-decompositio...
The first is high level perspective, the second is nitty gritty math, proof, and implementation.
[1]: https://jeremykun.com/2016/04/18/singular-value-decompositio...
[2]: https://jeremykun.com/2016/05/16/singular-value-decompositio...
I had a similar experience. Not only I passed linear algebra without understanding linear spaces, but I passed analytic geometry without learning any geometric concept that I didn't know.
I was randomly thinking about logarithms and it just "clicked" that what a logarithm really tells you about a number is it's order of magnitude relative to some base.
I had never seen it explained that way, but once I thought about it it seemed so simple. It's funny, programming has actually helped me understand math. It helps me to look at a formula or function as a programming function. I try to read maths like I read source code. I ask the same question: what dynamic system is this jumble of symbols trying to represent? How does an object behave as it moves through this system?
Once I began to think about math like that, a lot of things began to "click" for me.
I took linear algebra my freshman year of college. It was the non-math major course, so it didn't require proofs. I got an A+ in the class. Not just an A, an A+. I was able to obtain such a high grade by taking tons of practice tests, and since the actual tests were basically mildly veiled calculations, I just had to map the question to the right calculation. So for instance, if after a little interpretation, I figured out that the question was asking for me to calculate the singular value decomposition of a given matrix, I would mindlessly compute, check my algebra, and move on.
However, it was very clear to me by the end of the course that I didn't really understand what the heck linear algebra was about.
Five years later, I started a job as an algorithmic trader. One of the first things my boss wanted to do was to do a Principal Component Analysis (PCA) of bond price movements. This is a very common thing to do. I didn't know what PCA was, but I read a short paper he gave me and I was able to grok it. After reading that paper and actually performing the PCA (which by the way was basically one line of R code), I finally came to understand the core essence of linear algebra, which is the idea of linear transformations. I was able to connect the equation Ax=lambdax to the geometry of what an eigenvector meant. Through a little more reasoning, I realized that every real matrix corresponded to a linear transformation of that space via a rotation, a reflection, a stretching, a shearing, etc. At that point, all of the mindless calculations I had been doing half a decade earlier instantly clicked, and I was enlightened.
This was literally half a decade later after I "aced" my linear algebra class. I know that it seems absolutely ridiculous that I could "score so well" in a math class yet so clearly miss the core idea behind the entire class, but that's been my experience with math for as long as I can remember. You start by doing the calculations and just getting comfortable with them. Some arbitrary time later, you have an insight and suddenly everything is so crystal clear and trivial that you wonder how you could even not have understood it before.
Oh, and even to this day, I don't understand what singular values actually are. Something to do with a mapping from the row space to the column space, blah blah. I'm sure if I spent an hour to read about them and picture the geometry, I could figure it out, but I just haven't gotten around to doing it.