They are not as capable certainly but considering they didn't have anything like 3-4 years ago, I'd say the potential to catch up is there.

Also like OpenAI's Jalapeno, with LLMs it might be feasible to deploy relatively simpler silicon that's hard to program for, and farm out implementation to AI so the CUDA moat might be shallower than before.