News for hackers. Stuff that matters.
Re:Karatsuba Matrix Multiplication and Its Efficient Hardwar... by FL33TW00D on Wednesday March 19, 2025 @05:52AM (#43409957)
The TPU obviously uses a systolic array: https://jax-ml.github.io/scaling-book/tpus/
Re:Karatsuba Matrix Multiplication and Its Efficient Hardwar... by almostgotcaught on Wednesday March 19, 2025 @08:15AM (#43410880)
Fair enough - my understanding was they moved away from systolic arrays. I stand corrected. I will also say it is well-known they're basically impossible to program/build a compiler for.
Re:Karatsuba Matrix Multiplication and Its Efficient Hardwar... by FL33TW00D on Wednesday March 19, 2025 @09:39AM (#43411831)
This is why Google has 500 people working on the TPU compiler team.