I'm going to be starting out on one of these and coding-the-matrix is very python centric (which is super helpful and practical) versus MATLAB in Strang's book.
whether the code is in python or matlab matters little. the code is just a supplement to the main material which is still math. trying to understand that math by reading code is actively counterproductive and actually quite foolish. my professor gave a symposium talk on this topic, so i will use one of his examples -
At 0 minutes you have 0 dollars. suppose each minute you toss a coin. if it’s heads you make a dollar. if it’s tails you pay a dollar out of your pocket. What are the chances you’ll have $30 in an hour ?
This is the sort of classic problem that can be coded up in python or matlab under 5 minutes. it’s just a for loop & an if statement. It won’t tell you much about the actual probability because that number is so small your code will have to run for a long time to get a meaningful answer. Whereas it’s trivial if you just do the math by hand.
not what you thought though.
The obvious benefits are, much of math literature is currently written for consumption by math grad students & profs, so all of this will get a much needed rewrite. I foresee a surge in material like Jeremy Kun’s popular “math for programmers” book that so many of you loved on HN. Much of math lit is imo unnecessarily dense & terse. Speaking as a phd student, I really appreciate atleast 1-2 numerical examples with answers, not just plain theory. Maybe if there was a Linear Algebra for programmers text with some code in python to accompany the theorems, it would be a huge hit among applied ML researchers & programmers. Graduate linear algebra is actually quite hard & very few phd students pass the linalg quals in their first attempt ( Grad linear algebra, not basic shit like matrix algebra, linear maps & decompositions). This material should imo be rewritten ( “dumbed down” ) so regular folk can also sample some of the magic.
In my previous work at an adtech corp, I built a whole bidding algorithm straight from Strang’s linear algebra book (the chapter on Lagrange optimizers). It’s still running, 5 years & counting. I once joked if they gave a nickel out of every dollar that algorithm made to Prof Strang, he’d be a multimillionaire.