I don't actually think that the Google TPU is the paragon of deep learning processor architecture, there are a lot of things that I don't think are done very well.

In any case, that being said, the TPU is less of a CISC and much more like a lightweight RISC control mechanism.