I think you are right. Sorry, my bad! I remember the TPU paper Google had released last year (2017) circa March/ April, on performance evaluation of TPU's. Got a bit messed up.