Language models in particular are very similar architectures and effectively a lot of dot products. And running them on GPU's is arguably overkill. Look at llama.cpp for the way the industry is going. I want a fast parallel quantized dot product instruction on a CPU, and I want the memory bandwidth to keep it loaded up. Intel should be able to deliver that, with none of the horrible baggage that comes from CUDA and nvidia drivers.
I'm thinking about the widespread confusion they caused by having different CPUs support different subsets of the AVX-512 ISA.
Now while NVidia is making standard C++ run on CUDA, Intel is still having SYSCL and oneAPI extensions.
Similarly with Python and RAPIDS framework.
Intel and AMD have to up their game for the same kind of developer experience.
SYCL isn't pure C++, meaning writing STL code that goes into the GPU, like CUDA allows for, nor requires the hardware to follow C++ memory model.
How many of us learned ML using Compute Sticks, OpenVINO and OneAPI or another of their libraries or frameworks, or their great documentation? It's like they didn't really believe in it outside of research.
What irony is it when a bedrock of "AI" fails to dream?