News for hackers. Stuff that matters.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by SonOfLilit on Thursday December 14, 2017 @06:13PM (#15928200)
My test for linear algebra books is how they first present matrices and matrix multiplication.

If they define a matrix as an NxM table of numbers with a multiplication operation defined as this complicated formula with a couple of nested sigmas, and then much later a lemma is mentioned that says every linear transformation can be represented as a matrix and then the composition of two transforms is the matrix multiplication of their matrix forms, I throw the book away in disgust. I throw most books away in disgust.

This is the second book I've seen that does it right, but unlike the other one [1] this one wraps the very correct presentation of matrices in so much technical language and such a boring cover story that I almost threw it away in disgust anyway.

My greatest wish in STEM education is that we teach linear algebra better. It's such low hanging fruit and could change so much!

[1] which I saw linked in HN a year ago and don't remember the name of, but it was something like "linear algebra taught the correct way" and was apparently well known in the States so ask your friends

Re:Fundamentals of Linear Algebra and Optimization [pdf] by begriffs on Thursday December 14, 2017 @06:55PM (#15928545)
I think the book you're talking about is Axler's "Linear Algebra Done Right." I worked through the problems in this book with some friends, and it is a very good presentation.

After doing that book I wanted to see what other books were out there, which ones were the good ones, and sort of classify them. I came up with this list: https://begriffs.com/posts/2016-07-24-best-linear-algebra-bo...

I classify the books as Generalist (like Axler's), Theoretical (starting from e.g. modules rather than vector spaces), Numerical (matrix normal forms and algorithms), Practice (books full of problems), and a few other categories.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by wolfgke on Friday December 15, 2017 @08:11AM (#15931512)
> After doing that book I wanted to see what other books were out there, which ones were the good ones, and sort of classify them. I came up with this list: https://begriffs.com/posts/2016-07-24-best-linear-algebra-bo...

Ironically you put "Jänich, K. (1994). Linear algebra. New York: Springer-Verlag." into the "Theoretical" section: In Germany this book (its German original) is not that well-regarded, since it is considered as far to shallow. Much better (and more hard to read) German textbooks are

Gerd Fischer - Lineare Algebra: Eine Einführung für Studienanfänger (Linear Algebra: An Introduction for freshmen)

Siegfried Bosch - Lineare Algebra (and its companion book: Siegfried Bosch - Algebra)

Re:Fundamentals of Linear Algebra and Optimization [pdf] by begriffs on Tuesday December 26, 2017 @01:02AM (#16007372)
You're right, I made a mistake. Just reviewed the table of contents on Amazon and it looks pretty short, and not particularly theoretical. Also poorly reviewed. I don't remember how it got on my list but I'm removing it.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by linkmotif on Friday December 15, 2017 @12:30AM (#15929845)
Aweomse. Thank you. Jealous of you and your friends. Wish I had a Pythagorean squad :)
Re:Fundamentals of Linear Algebra and Optimization [pdf] by sn9 on Saturday December 16, 2017 @12:22AM (#15937881)
I've heard Shilov's text described as a great complement to Axler's.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by jacobolus on Thursday December 14, 2017 @08:34PM (#15929047)
Starting with an abstract formal description of vector spaces and linear transformations is not a pedagogically useful introduction, and it leaves out a huge amount of the historical/motivational context explaining most of the conventions used in linear algebra, and even the mental/conceptual understanding most working mathematicians have about the meaning of linear models and their use in various parts of mathematics (not even to mention people in other STEM fields).

The two places to start historically (and easily accessible to high school students) are:

(1) understanding and working with displacement vectors in 3-dimensional Euclidean affine space and in general thinking about transformation geometry (sometime later this can be extended to other kinds of non-Euclidean or non-metrical geometry), especially with reference to problems in Newtonian mechanics.

(2) systems of linear equations: this one is inherently coordinate-heavy and matrix based, at least to start out, and explains our conventions for how matrices are written, index order, multiplication of matrices by "column" vectors on the right, the use of matrix equations to fold several equals signs into one, etc.

After that I'd call out the manipulation of vectors of polynomial coefficients as an accessible additional concrete example of a linear space.

Discussion of other linear spaces or more purely abstract treatments proving properties from axioms can come sometime later, after students have familiarity with some of those tools, and after they have applied them to some problems in statistics, multivariable calculus, computer graphics, ODEs, optimization, etc.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by jacobolus on Friday December 15, 2017 @01:53AM (#15930110)
And to follow-up, note that this book in particular is for a graduate-level course in the department of computer and information science, which has an undergraduate-level linear algebra course as a prerequisite.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by tomjakubowski on Thursday December 14, 2017 @07:56PM (#15928884)
Strang’s textbook (and lectures) introduce matrix multiplication AB as combinations of A’s columns. He uses the cell-by-cell / “dot product” formulas just to check his work, which seems reasonable to me. I’m a big fan of “combinations of columns”. I sometimes even hear that in Strang’s voice when I’m doing some matrix multiplications.

Axler was way too abstract for me as a first linear algebra book. I look forward to returning to it once I finish Strang.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by internetman55 on Friday December 15, 2017 @02:50PM (#15934481)
Strang's exposition can make you a wizard of matrix multiplication and give you quite a good intuition for various properties of matrix operations, in my opinion.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by jpau on Thursday December 14, 2017 @06:20PM (#15928269)
Might [1] be "Linear Algebra Done Right" by Axler? http://www.springer.com/gp/book/9783319110790
Re:Fundamentals of Linear Algebra and Optimization [pdf] by j2kun on Thursday December 14, 2017 @07:28PM (#15928746)
To this book's credit, it covers a LOT more material than Axler's book. And it's more heavily focused on optimization methods for which the details of tabular representations of matrices takes center stage.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by igniousrock on Saturday December 16, 2017 @05:14PM (#15942486)
To me, matrices and matrix multiplication really represent the "calculus" of linear algebra. When you are studying real analysis, the theory part (closed, open sets, definition of limit points, continuity, etc) are not actually that helpful when doing a computation (calculating and integral or derivative). It often makes sense to teach a student the calculation side before the theory because its easier to get a intuition for.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by spraak on Thursday December 14, 2017 @08:03PM (#15928917)
I'm curious what you think of the "No Bullshit Guide to Linear Algebra" [1]? I'm considering buying it to refresh my knowledge from school. Or what books do you suggest?

[1] https://www.amazon.com/No-bullshit-guide-linear-algebra/dp/0...

Re:Fundamentals of Linear Algebra and Optimization [pdf] by SonOfLilit on Friday December 15, 2017 @09:45AM (#15932134)
It... more or less passes the test?

I mean, it defines matrix-vector product in a nice but abstract way, and then in the next paragraph explains why we chose that definition. And it does say "this, this here is the one important idea in this book", which it gets many points for.

I really would prefer a textbook to start with "ok, here's something we want to do. Lets figure out a formula for it. Now lets give it the name matrix-vector product".

Same for matrix-matrix products.

I don't know any really good linear algebra books, in my school it was taught the worst possible way (define a field, rote-learn the mechanical operation of matrix multiplication, talk about vector spaces for a while, talk about matrices, first mention linear transformations). Some people on this thread gave other suggestions, I'd start reading a few and choose the one I connect with the best.

Anyway, I really learned linear algebra from using it.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by ivan_ah on Thursday December 14, 2017 @09:27PM (#15929259)
Here is a direct link to the page in the preview of the book where the matrix-product-is-the-same-as-linear-transformation idea first appears: https://minireference.com/static/excerpts/noBSguide2LA_previ...

I can't quite tell if the book passes the test, since the entry-point is the definition of matrix-vector product which is very close to a "complicated formula with a couple of nested sigmas" but the book also mentions the notion of matrix representations, so hard to tell overall.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by abecedarius on Thursday December 14, 2017 @06:44PM (#15928469)
Another text that starts with linear transformations is Apostol’s Calculus. It’s somewhat more concrete than Axler, IIRC — e.g. it doesn’t try to avoid determinants, but starts with properties of volume-scaling and then develops the determinant formula out of those. We used this text for freshman/sophomore math back in the 80s, so my memory is fuzzy; but I liked it a lot.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by kccqzy on Thursday December 14, 2017 @10:16PM (#15929442)
I don’t necessarily agree though. I’ve seen books first trying to introduce linear transformation without matrices and frankly to a beginner it’s even more confusing to be told f is linear if f(ax+y)=af(x)+f(y). Some students really need a concrete grasp of matrices with actual numbers they are familiar with before going into the abstract definition.

I’ve seen worse though: those that attempt to shoehorn abstract algebra in the process by first rigorously defining a field.

And no, teaching multiplication doesn’t involve memorizing a formula; it’s a simple mechanical process of arranging one matrix on the left the other at the top and multiplying/adding their corresponding rows and columns. Once this process is familiar to a student, they will have no trouble writing out the formula with nested sigmas.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by internetman55 on Friday December 15, 2017 @02:47PM (#15934462)
I don't understand what's so wrong about that. Surely the interested student would like to learn about the properties of matrix arithmetic as well as vector spaces, linear transformations and their representation as matrices, etc.

I've had a quite accomplished mathematician for a professor who was very adamant that students should learn about basic matrix operations before the abstract theory. According to him, his undergraduate education at Princeton did things the "right" way, but left him quite confused about the main ideas and motivations. He ended up making some quite important contributions to the theory of representations of some certain algebraic structures if I recall correctly.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by SonOfLilit on Sunday December 17, 2017 @01:07AM (#15944445)
They way I was taught was like learning how to do long-form multiplication without mentioning that "the product of 5 and 6 is 5+5+5... 6 times".
Re:Fundamentals of Linear Algebra and Optimization [pdf] by andars on Thursday December 14, 2017 @06:40PM (#15928440)
The Friedberg, Insel, Spence book [1] passes your test. Linear transformations first, then matrices as a representation of transformations with respect to a specified basis. Depending on your tastes, you may find it too dry, but imo it is a clean presentation.

[1]: https://www.amazon.com/Linear-Algebra-4th-Stephen-Friedberg/...

Re:Fundamentals of Linear Algebra and Optimization [pdf] by nextos on Thursday December 14, 2017 @08:51PM (#15929110)
Do you have any other tests for calculus, analysis, abstract algebra, discrete mathematics, probability or statistics books?
Re:Fundamentals of Linear Algebra and Optimization [pdf] by kccqzy on Friday December 15, 2017 @12:13AM (#15929797)
For me my test for multivariable calculus text is their treatment of the chain rule. If the book says something like “derivative of a composition is the composition of the derivatives” it’s good. If they instead say something involving a sigma and things like ∂f/∂x ∂x/∂t it’s likely bad.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by apricot on Sunday December 17, 2017 @12:06PM (#15946539)
What do you mean by "derivative of a composition is the composition of the derivatives"?
Re:Fundamentals of Linear Algebra and Optimization [pdf] by kccqzy on Sunday December 17, 2017 @06:25PM (#15948254)
You need to think of a derivative as just a function that takes a function, a point, and returns a linearized function that best approximates the original function at that point.

So basically the chain rule states that if you have two functions F, G composed together and you want to find the derivative (the linearized approximation), you simply compute the linearized function for both F and G, and compose the linearized version afterwards.

You can read the Wikipedia article on the chain rule and it eventually gives this simple and elegant formula for the chain rule: https://wikimedia.org/api/rest_v1/media/math/render/svg/8b0f...

But the unfortunate reality is that too many textbooks formulate the chain rule in such a complicated manner that it obscures the simplicity and elegance of the chain rule.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by apricot on Monday December 18, 2017 @10:44PM (#15957567)
Thank you for the explanations. I agree with you that this more abstract view of the chain rule (and the derivative itself) is superior to the sum-of-products formula one usually sees in a first course in multivariable calculus, but I feel most students have to learn the complicated, technical version first before they can see the beauty of the more abstract one.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by wging on Thursday December 14, 2017 @08:26PM (#15929011)
IIRC, Apostol's Calculus, volume 2, does it right (linear transformations first, then matrices).
Re:Fundamentals of Linear Algebra and Optimization [pdf] by Tomte on Sunday December 17, 2017 @06:44AM (#15945357)
Stupid question: is the order of elements in matrix notation just convention or is there a deeper reason for it? Could we just as well have used „transposed matrices“?
Re:Fundamentals of Linear Algebra and Optimization [pdf] by jknz on Thursday December 14, 2017 @11:22PM (#15929664)
I would teach linear algebra with a book that barely mentions linear transformations.

In finite dimensions, linear transformations and matrices are exactly the same object mathematical objects, with very different notations (matrix notation (boxes with numbers inside) vs the linear space/linear transformation notation). I would rather the students to learn deeper mathematics only in matrix notation, rather than to master less substantial mathematics with both notations.

Teaching both notations may reinforce the idea that matrices and linear transformations are different mathematical objects in finite dimension. Teaching the more abstract notation is mainly useful in infinite dimension (Hilbert spaces).

Re:Fundamentals of Linear Algebra and Optimization [pdf] by btilly on Friday December 15, 2017 @01:08AM (#15929947)
This is exactly backwards.

Whether you're discussing the Jacobian of a function, or change of basis matrices, learning the matrix formula is a lot less useful than seeing how it falls out of the linear function definition.

The formula is hard to memorize and gives no intuition for why anything is true. But from the linear function definition it is easy to reconstruct the formula.

In fact this is so true that I would say that anyone who only knows the matrix definition does not actually understand linear algebra.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by jacobolus on Friday December 15, 2017 @01:31AM (#15930029)
You have succumbed to the coordinate virus, http://geocalc.clas.asu.edu/pdf/MathViruses.pdf
Re:Fundamentals of Linear Algebra and Optimization [pdf] by wolfgke on Friday December 15, 2017 @08:13AM (#15931525)
> In finite dimensions, linear transformations and matrices are exactly the same object mathematical objects

They are not: Matrices represent linear transformations with respect to a given basis. Linear transformations are completely independent from any chosen basis.

Re:Fundamentals of Linear Algebra and Optimization [pdf] by catnaroek on Friday December 15, 2017 @01:26AM (#15930008)
And you would forever cripple your students. As potential users of linear algebra, they would be mentally mutilated beyond all hope of regeneration.
Re:Fundamentals of Linear Algebra and Optimization [pdf] by catnaroek on Thursday December 14, 2017 @08:53PM (#15929117)
> My greatest wish in STEM education is that we teach linear algebra better.

That's easy. Vector spaces and linear transformations are best understood abstractly. Matrices are best understood as visually and computationally convenient representations of tensor products, so don't mention matrices at all until well after you have established the basic properties of tensor products, in particular, the natural isomorphism between `L(V,W)` and `Dual(V) (x) W`.