There's an email that gets posted on HN periodically that says something like "To the chagrin of AI researchers, the best way to improve AI is to throw more computing power at it"

So yes we still need new ideas like transformers, but the real enabler of more and more powerful AI is more and more powerful computers