News for hackers. Stuff that matters.
Re:Visual Explanation of the Conjugate Gradient Algorithm by nimish on Tuesday September 15, 2020 @12:06AM (#24477782)
I always thought it was simpler to explain by using the only trick linear algebra has: switch to a basis where your problem is easiest, then switch back.

Sylvester's law of inertia proves existence + gram-schmidt constructs that change of basis

Re:Visual Explanation of the Conjugate Gradient Algorithm by zzleeper on Tuesday September 15, 2020 @12:21AM (#24477852)
I was recently re-reading how to solve systems via QR and realized that the key trick was switching basis. But it took me a while to understand that, in between all the extra stuff. Now you are telling me that most of LA is like that and wow, so many things make sense now!

Do you have any additional linear algebra tricks?

Re:Visual Explanation of the Conjugate Gradient Algorithm by nimish on Tuesday September 15, 2020 @01:37AM (#24478182)
Linear algebra done right is IMO the best book on it.

But a lot of it is simply exploiting linearity to reduce to a working in the most convenient subspaces. Finding and constructing them is a major task.

Re:Visual Explanation of the Conjugate Gradient Algorithm by nimish on Tuesday September 15, 2020 @01:58PM (#24484400)
I'd go so far as to say if your LA class did not instill that one value it was more a matrix algebra and methods (nothing wrong w/ that....v useful) class.

The matrix is simply the model of the linear space. Coordinate free-ness lets you get away from coefficient chasing and tedium to focus on the real stuff.

Esp important in infinite dimensional vector spaces where many theorems cannot rely on a basis existing as it is equivalent to the axiom of choice.

Re:Visual Explanation of the Conjugate Gradient Algorithm by nitrogen on Tuesday September 15, 2020 @01:07AM (#24478056)
If you haven't watched the videos frome 3blue1brown on YouTube, you definitely should.
Re:Visual Explanation of the Conjugate Gradient Algorithm by SomeHacker44 on Tuesday September 15, 2020 @12:31AM (#24477893)
>any additional linear algebra tricks? >> the only trick linear algebra has
Re:Visual Explanation of the Conjugate Gradient Algorithm by lowkeynthorough on Tuesday September 15, 2020 @01:49AM (#24478240)
Lol that trick also covers much of quantum mechanics, and relativity. (The gauge in “gauge theory” is a basis, btw)
Re:Visual Explanation of the Conjugate Gradient Algorithm by nimish on Tuesday September 15, 2020 @08:31AM (#24480459)
A large amount of mathematics is trying to find the easiest way to express a problem, changing to that view, solving the simpler problem, then going back to your original formulation

Solving indefinite integrals by substitution for example. Justified by the chain rule.