Google Translate was probably the first commercial product to utilize Transformer architecture and also training it absolutely racked up a huge bill to NVidia probably even way back in the day up to now