News for hackers. Stuff that matters.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by btilly on Tuesday June 06, 2017 @12:12PM (#14498343)
The first mistake that I found is, All eigenvectors that correspond to one eigenvalue lie on the same line, but have different magnitudes.

The eigenvectors for [[1 0] [0 1]] are 2 dimensional.

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by dragandj on Tuesday June 06, 2017 @12:16PM (#14498380)
Can you give an example of two eigenvectors that do not lie on the same line? (I am curious, I am not a mathematician)
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by btilly on Tuesday June 06, 2017 @12:22PM (#14498444)
[1 0] and [0 1] are both eigenvectors of the identity matrix, yet not on the same line.

I highly recommend http://www.axler.net/DwD.html for developing a good intuition about what eigenvalues and eigenvectors actually are.

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by agandy on Tuesday June 06, 2017 @12:57PM (#14498788)
The book based on this paper is one of the best text books I've read. I highly recommend reading it if you're looking for a solid understanding of linear algebra.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by tptacek on Tuesday June 06, 2017 @03:02PM (#14500129)
As someone who worked their way through Strang (we did a little study group and did the homework assigned to some class at Rutgers), I'd love it if someone could take a moment to explain what they like so much about Axler. I've tried a couple times to slog my way through Axler and had not much success.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by jacobolus on Tuesday June 06, 2017 @04:35PM (#14501067)
I’m not in the target audience and have neither learned nor taught from Axler’s book, so I can’t tell you precisely what people like about it, but it is aimed at pure math undergraduates who are interested in using linear algebra in much more abstract contexts, and focuses more on proofs than many introductory linear algebra textbooks.

Not sure if they’re useful (I haven’t watched them), but Axler made a series of videos about the core content of his book https://www.youtube.com/watch?v=lkx2BJcnyxk&list=PLGAnmvB9m7...

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by pvg on Tuesday June 06, 2017 @05:13PM (#14501399)
it is aimed at pure math students who are interested in using linear algebra in much more abstract contexts

I don't think that's really true. The book itself puts it much more simply and directly, at the very beginning in 'Preface for the Instructor':

"You are about to teach a course that will probably give students their second exposure to linear algebra."

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by btilly on Tuesday June 06, 2017 @05:20PM (#14501449)
Not a contradiction. Their first exposure would have been something like multivariable Calculus. So students have seen matrices, but they were magic, unmotivated, and probably didn't make much sense except in a "here is the formula to memorize" kind of way.

Axler tries to teach students how to understand linear algebra.

If all that you want to do is use it, the prospect of that understanding may not be very motivating.

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by pvg on Tuesday June 06, 2017 @05:34PM (#14501574)
I didn't say there was some contradiction. I just don't think the key difference between Strang and Axler is really the degree of mathsiness.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by btilly on Tuesday June 06, 2017 @05:58PM (#14501782)
I was commenting about what Axler is, and not comparing it to anything else.

My point is that the comment that you quoted from the preface in no way changes the fact that the book's point is to convey an understanding of linear algebra that is primarily of interest to people going on in math.

Now I happen to think it is the right way to understand linear algebra and is how people in other fields should think about it. Because it is easier to figure out again if you've not done it in a while. But this point of view is primarily going to motivate would be mathematicians.

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by pvg on Tuesday June 06, 2017 @06:04PM (#14501829)
and not comparing it to anything else.

Sure, but the topic is 'Given Strang, what's the deal with Axler'. It's a perfectly sensible question in its own right.

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by jacobolus on Tuesday June 06, 2017 @05:20PM (#14501444)
You don’t think this book is aimed at pure mathematics students?

It’s certainly not aimed at numerical analysis students, or engineering students, or physics students. (Which isn’t to say that those students can’t take pure math courses if they want.)

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by pvg on Tuesday June 06, 2017 @05:32PM (#14501554)
I mean in the context of Strang. I don't think Strang is aimed strictly at, say, engineering students. To me, the difference is the starting point, more than anything else.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by jacobolus on Tuesday June 06, 2017 @05:42PM (#14501644)
As far as I can tell Strang’s target audience is something like: most undergraduates at MIT who didn’t already learn the subject before arrival, except the pure math students who are likely to substitute a more theoretical course (18.700 or 18.701 vs. 18.06).
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by pvg on Tuesday June 06, 2017 @05:53PM (#14501748)
Right. Each is aimed at somewhat different audiences. We're undoubtedly getting into some pretty fine hairsplitting, the thing I was whining about is 'pure maths students' and 'everyone else' is not an accurate way to describe them.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by tnecniv on Tuesday June 06, 2017 @03:22PM (#14500340)
I have both Axler and Strang. I learned from Axler but occasionally use Strang as a reference. I find that Axler emphasizes the algebra part of linear algebra while Strang emphasizes the linear part. One isn't better than the other but one might make more sense to different people.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by tanderson92 on Tuesday June 06, 2017 @03:37PM (#14500499)
Axler avoids determinants with a passion. For good reason, too, because they are not helpful in understanding how spaces interact. I forget how Strang proves the spectral theorem but compared to Lax the pedagogy could not be more different. Determinants are really nice tools for short proofs, but not helpful in understanding. But Axler is the way you want to think about linear algebra as a practitioner.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by pvg on Tuesday June 06, 2017 @04:10PM (#14500852)
Axler is easier to digest if you have some familiarity with the tools and the jargon but hated/forgot everything in your college linear algebra course.

A (very imperfect) analogy might be something like the GoF book vs Peter Norvig's essay on design patterns.

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by stablemap on Tuesday June 06, 2017 @05:06PM (#14501331)
It is probably logically unnecessary but I think it's best to have experience with the "computational" aspects of linear algebra before diving into Axler's book.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by dragandj on Tuesday June 06, 2017 @12:33PM (#14498562)
I obviously formulated this wrong. Will rephrase, but doesn't the intuiton generally hold that when you find an eigenvector for one eigenvalue, then you can construct infinite number of eigenvectors by scaling that one?
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by btilly on Tuesday June 06, 2017 @12:44PM (#14498654)
Yes, that is trivially true. In fact any linear combination of eigenvectors for the same eigenvalue will be an eigenvector for that eigenvalue.

Another important point to appreciate is that eigenvalues and eigenvectors frequently require complex numbers. For example the eigenvalues of [[0 1] [-1 0]] are i and -i. This geometrically correlates with some kind of "rotation".

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by kgwgk on Tuesday June 06, 2017 @01:10PM (#14498918)
The problem arises when there is degeneration (some eigenvalues are repeated). See for example https://www.ch.ntu.edu.tw/~byjin/course/ChemMath/handouts/de...

[edit: the rest of my original comment was not correct]

If an eigenvalue is unique, the corresponding eigenvectors are on a line. If it appears twice, the corresponding eigenvectors are [edit: could be] on a plane. In general, they span [edit: could span] a subspace of dimension equal to the multiplicity.

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by neutronicus on Tuesday June 06, 2017 @01:32PM (#14499143)
The dimension of the space spanned by the eigenvectors associated with a degenerate eigenvalue is bounded above by the algebraic multiplicity of the eigenvalue and bounded below by one.
Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by btilly on Tuesday June 06, 2017 @01:28PM (#14499101)
Not true. The matrix [[1 1] [0 1]] has the eigenvalue 1 repeated twice but the eigenvectors are on a line.

The generalized eigenvectors are on a plane.

The case where the eigenvectors do not span the space corresponds to matrices whose Jordan normal form has upper triangular bits.

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by gizmo686 on Tuesday June 06, 2017 @07:24PM (#14502376)
You seem to have reworded to "All eigenvectors that correspond to one a unique eigenvalue lie on the same line, but have different magnitudes." This is technically true if you interpret "unique" to mean "multiplicity of one", but still seems confusing, especially as you have not yet discussed the multiplicity of eigenvalues.

I would consider rephrasing the article as you do in the above comment, "when you find an eigenvector for one eigenvalue, then you can construct infinite number of eigenvectors by scaling that one".

Re:Clojure Linear Algebra Refresher: Eigenvalues and Eigenve... by stablemap on Tuesday June 06, 2017 @12:21PM (#14498425)
What he gives is the identity matrix—multiply on the right by any 2x1 vector and you will get that vector back. So any such vector, provided it is not the zero vector, is an eigenvector with eigenvalue 1.