News for hackers. Stuff that matters.
Re:Mathematicians are chronically lost and confused (2014) by vecter on Friday June 10, 2016 @05:06AM (#11875146)
I have a great personal story that highlights how long the journey of understanding mathematics is.

I took linear algebra my freshman year of college. It was the non-math major course, so it didn't require proofs. I got an A+ in the class. Not just an A, an A+. I was able to obtain such a high grade by taking tons of practice tests, and since the actual tests were basically mildly veiled calculations, I just had to map the question to the right calculation. So for instance, if after a little interpretation, I figured out that the question was asking for me to calculate the singular value decomposition of a given matrix, I would mindlessly compute, check my algebra, and move on.

However, it was very clear to me by the end of the course that I didn't really understand what the heck linear algebra was about.

Five years later, I started a job as an algorithmic trader. One of the first things my boss wanted to do was to do a Principal Component Analysis (PCA) of bond price movements. This is a very common thing to do. I didn't know what PCA was, but I read a short paper he gave me and I was able to grok it. After reading that paper and actually performing the PCA (which by the way was basically one line of R code), I finally came to understand the core essence of linear algebra, which is the idea of linear transformations. I was able to connect the equation Ax=lambdax to the geometry of what an eigenvector meant. Through a little more reasoning, I realized that every real matrix corresponded to a linear transformation of that space via a rotation, a reflection, a stretching, a shearing, etc. At that point, all of the mindless calculations I had been doing half a decade earlier instantly clicked, and I was enlightened.

This was literally half a decade later after I "aced" my linear algebra class. I know that it seems absolutely ridiculous that I could "score so well" in a math class yet so clearly miss the core idea behind the entire class, but that's been my experience with math for as long as I can remember. You start by doing the calculations and just getting comfortable with them. Some arbitrary time later, you have an insight and suddenly everything is so crystal clear and trivial that you wonder how you could even not have understood it before.

Oh, and even to this day, I don't understand what singular values actually are. Something to do with a mapping from the row space to the column space, blah blah. I'm sure if I spent an hour to read about them and picture the geometry, I could figure it out, but I just haven't gotten around to doing it.

Re:Mathematicians are chronically lost and confused (2014) by wmsiler on Friday June 10, 2016 @09:23AM (#11876152)
Linear algebra is the sort of topic where it seems like you can always go deeper. I also got an A in my linear algebra class in college. When I got to grad school for math, I took the first year graduate course on algebra and saw linear algebra in terms of algebraic things like modules and representations. I decided that I hadn't really known linear algebra before, but that I did then. Then I took differential geometry, which involves studying infinite collections of vector spaces parameterizes by points on a manifold. I realized I still hadn't know linear algebra, but after that I certainly did. Then I took a functional analysis class, where we did infinite dimensional linear algebra, where a lot of the finite dimensional theory has analogues but everything is more complicated (e.g. instead of finite bases and dot products, you consider things like Fourier analysis and Hilbert spaces).

The same realization that I don't know linear algebra came when taking a Lie algebras class, and again when learning homological algebra, and probably a few other times as well. There are certainly lots of areas of math that I've never explored that take linear algebra in some other direction (for example, I don't have any idea what the applied math guys do with....).

It's really an amazingly vast subject, especially considering that it's usually just thought of as a tool used to study more advanced topics.

Re:Mathematicians are chronically lost and confused (2014) by bglazer on Friday June 10, 2016 @11:03AM (#11876838)
I've been learning (trying to learn) linear algebra by studying Gilbert Strang's "Introduction to Linear Algebra" book. There are some really mind bending sections in which he explicitly treats a concept like linear regression in terms of geometry and then algebra and then calculus and then probability and then ties them all back together.

What's really struck me is when I dive into a Wikipedia rabbit hole of linear algebra, following links for terms I don't know. I start on the Topology page, read the introduction section of 10 articles that start with "x is a generalization of y" and somehow end up back on the Topology page. Shallow exposure to the sheer volume and conceptual depth of stuff like topology and algebra has really made me respect modern math.

Re:Mathematicians are chronically lost and confused (2014) by kenjackson on Friday June 10, 2016 @07:10AM (#11875535)
I've had a similar experience several times. I feel like in college I was mentally much faster, but lacked insight (and probably curiosity).

There have been several times when I've picked up an old math or CS textbook and read something I never really fully understood in college -- it almost instantly makes intuitive sense to me now -- 20 years later.

There's an old saying that college is wasted on the young... in many ways I believe it is true.

Re:Mathematicians are chronically lost and confused (2014) by daniel-levin on Friday June 10, 2016 @11:57AM (#11877288)
This is also largely a consequence of the fact that most linear algebra courses are computational by nature. They'll ask you to compute lots of things as a means of assessment. Work out this determinant. Find the eigenvalues of that matrix. "Matrices are grids of numbers". Take this matrix and write it in terms of this other basis. I only really perceived the impact of linear transformations being vector-space-structure preserving mappings long after I'd seen their analogues in the form of homomorphisms, homeomorphisms, diffeomorphisms etc. Nobody told us that determinants are just the alternating k-tensor on real k-space (up to a constant factor). At some level, this is because most students taking linear algebra don't have the mathematical maturity to stomach a course in finite dimensional vector spaces. I was indignant when I found out that a matrix was not just a grid of numbers, but rather a manifestation of a linear transformation, with respect to a particular basis.

I only really started to understand linear algebra when I was forced to in a differential geometry class. The opening chapters were a review intended to fix my university's notoriously broken linear algebra training. As I said, it comes with the territory. You can't design a course based on Halmos' FDVS and expect students coming in, that is, students who've scraped through calculus 1, to manage. So, the recipe book / cookbook style abounds. Granted, there were inklings of mathematics in my linear algebra course. I don't think anyone really appreciated it however. It's hard to grok "vector space over a field" when you've never been introduced to the abstract concept of a field.

When my second year stats lecturer told me that a determinant of a 2x2 matrix was an area, I almost didn't believe him.

Fun exercise I was told about just the other day. Every invertible matrix with integer coefficients has determinant +-1. I would never have known how to solve that after my linear algebra course.

Re:Mathematicians are chronically lost and confused (2014) by abecedarius on Friday June 10, 2016 @01:29PM (#11878106)
I'm confused: [42] is an invertible matrix with integer coefficients, right?
Re:Mathematicians are chronically lost and confused (2014) by taejo on Friday June 10, 2016 @01:54PM (#11878386)
I guess daniel-levin meant to say "invertible matrix with integer coefficients whose inverse also has invertible coefficients". The fact isn't too hard to see:

* If M has integer coefficients, then det(M) is an integer. * det(inv(M)) = 1/det(M) * Since M has integer coefficients, det(M) is an integer * Since inv(M) has integer coefficients, det(inv(M)) is an integer * So det(M) and 1/det(M) are both integers, so det(M) is either 1 or -1

Re:Mathematicians are chronically lost and confused (2014) by taejo on Saturday June 11, 2016 @08:29AM (#11883212)
s/invertible coefficients/integer coefficients/
Re:Mathematicians are chronically lost and confused (2014) by sixo on Friday June 10, 2016 @02:00PM (#11878446)
Yes, the claim is false. It's not obvious to me what it's been confused for. Edit: oh, the other commenter figured it out.
Re:Mathematicians are chronically lost and confused (2014) by lordnacho on Friday June 10, 2016 @05:11AM (#11875160)
Wow, that's oddly similar to my story.

LinAlg in college, nothing but a blur of matrices.

Algo trading for work. Now there's a reason to do it, it makes sense.

About SVD, btw, it is another path to PCA, one that solves certain problems that PCA does not.

https://jeremykun.com/2016/04/18/singular-value-decompositio...

Re:Mathematicians are chronically lost and confused (2014) by j2kun on Friday June 10, 2016 @12:38PM (#11877640)
I recently wrote two articles I think you would enjoy :)

The first is high level perspective, the second is nitty gritty math, proof, and implementation.

[1]: https://jeremykun.com/2016/04/18/singular-value-decompositio...

[2]: https://jeremykun.com/2016/05/16/singular-value-decompositio...

Re:Mathematicians are chronically lost and confused (2014) by IndianAstronaut on Friday June 10, 2016 @06:37AM (#11875442)
Math programs in general suck at telling you why a particular technique is useful in the real world, or more importantly, how to model. Lots of ways to solve an existing model, but very few touch the much harder task of building a model in the first place.
Re:Mathematicians are chronically lost and confused (2014) by Retra on Friday June 10, 2016 @09:55PM (#11881601)
Students and parents are demanding that their education fees generate employable graduates, not creative or intelligent ones. This trend will probably continue as long as education keeps getting more expensive.
Re:Mathematicians are chronically lost and confused (2014) by marcosdumay on Friday June 10, 2016 @10:41AM (#11876655)
In general, mathematicians are bad teachers for introductory Math courses (shouldn't be very surprising, experts are often bad teachers for introductory courses). Too bad universities think they are the most prepared for that.

I had a similar experience. Not only I passed linear algebra without understanding linear spaces, but I passed analytic geometry without learning any geometric concept that I didn't know.

Re:Mathematicians are chronically lost and confused (2014) by alistproducer2 on Friday June 10, 2016 @11:37AM (#11877117)
Similar theme:

I was randomly thinking about logarithms and it just "clicked" that what a logarithm really tells you about a number is it's order of magnitude relative to some base.

I had never seen it explained that way, but once I thought about it it seemed so simple. It's funny, programming has actually helped me understand math. It helps me to look at a formula or function as a programming function. I try to read maths like I read source code. I ask the same question: what dynamic system is this jumble of symbols trying to represent? How does an object behave as it moves through this system?

Once I began to think about math like that, a lot of things began to "click" for me.

Re:Mathematicians are chronically lost and confused (2014) by fahadkhan on Friday June 10, 2016 @06:42AM (#11875448)
Somewhat ashamedly, I have a 1st Class BSc Honours in Mathematics with much the same experience. It's fairly easy to fake an understanding of mathematics if you can understand that the exams paper will be a variant past exam papers.
Re:Mathematicians are chronically lost and confused (2014) by seanalltogether on Friday June 10, 2016 @04:48PM (#11879893)
I think this is why I enjoyed physics classes more then math classes. The formulas we were taught had a visible effect. I could watch the values transform to something I could physically confirm at each step. As a result the formulas became more obvious and therefore more memorable.
Re:Mathematicians are chronically lost and confused (2014) by larme on Friday June 10, 2016 @10:52AM (#11876744)
Just out of curiosity, do you remember the title of the PCA paper?