Anyone with a passing interest in designing an AI Chip should listen to the last Latent Space pod with Dylan Patel of SemiAnalysis.

You either assume transformers are here to stay and somehow get an edge over Nvidia and others trying to do the same or you make a huge variety of bets on whats next.

https://www.latent.space/p/semianalysis#details