Re:Karatsuba Matrix Multiplication and Its Efficient Hardwar...
by imtringued on Wednesday March 19, 2025 @02:47AM
(#43408895)
https://cloud.google.com/tpu/docs/system-architecture-tpu-vm...
>The primary task for TPUs is matrix processing, which is a combination of multiply and accumulate operations. TPUs contain thousands of multiply-accumulators that are directly connected to each other to form a large physical matrix. This is called a systolic array architecture. Cloud TPU v3, contain two systolic arrays of 128 x 128 ALUs, on a single processor.
Re:Karatsuba Matrix Multiplication and Its Efficient Hardwar...
by robinhouston on Wednesday March 19, 2025 @05:34AM
(#43409849)
I don't see any contradiction between your claim that TPU v3 uses systolic arrays and the parent post's claim that TPU v4 does not.
Re:Karatsuba Matrix Multiplication and Its Efficient Hardwar...
by FL33TW00D on Wednesday March 19, 2025 @05:52AM
(#43409957)
The TPU obviously uses a systolic array:
https://jax-ml.github.io/scaling-book/tpus/
Re:Karatsuba Matrix Multiplication and Its Efficient Hardwar...
by almostgotcaught on Wednesday March 19, 2025 @08:15AM
(#43410880)
Fair enough - my understanding was they moved away from systolic arrays. I stand corrected. I will also say it is well-known they're basically impossible to program/build a compiler for.
this is wrong. TPUv4 has tensor cores just like NVIDIA has tensor cores just like AMD has tensor cores. no one uses a systolic array because bandwidth/connectivity is much scarcer than compute. the only people that keep talking about them are academics that don't actually fab/sell chips.
https://cloud.google.com/tpu/docs/v4
https://www.nvidia.com/en-us/data-center/tensor-cores/
https://rocm.docs.amd.com/projects/rocWMMA/en/latest/what-is...
ninja edit: before you gotcha me with "a tensor core is a systolic array!!!" - most tensor cores are actually outerproduct engines not riffle shuffle engines (or whatever you wanna call the topology corresponding to a systolic array).