>Attention Is All You Need paper detailing transformers, and it would be an entirely different market if Google had held that as a trade secret.

I would guess that in that timeline, Google would never have been able to learn about the incredible capabilities of transformer models outside of translation, at least not until much later.