Intel could totally try to capture the LLM market 'bottom up' if they wanted to.
As an underdog in the GPU market, all they need to do is start by making cheap boards with lots of VRAM. I'm talking 32GB boards under 1k.
They don't have to be fast. They just have to take these bigger models into VRAM and be fast enough that it's better than dealing with normal CPU+RAM.
That gets them into the market, and then they can follow up with more expensive and 'enterprisey' silicon that is faster for the data centers.
Alas, that's probably too alien a thought for Intel, as they prefer that thick margin...
1) How might Nvidia etc respond? They've made one-off SKUs for crypto, they could certainly respond quickly with a part that matched on memory but had much better software (meaning, more compatible with tools and better performance. AMD doesn't have the software, but their hardware is find and they could similarly up on-board memory. So Intel would really have to compete on price.
2) Ok, now we've found some 2nd or 3rd place success in a business built on logic fabbed at TSMC and DRAM from Samsung or Micron. If this is the future, why have fabs or any of the associated R&D?
I don't know what the right answers are but maintaining Intel at anything resembling its current size seems like a pretty tough puzzle.
Indeed. And his first action was to diss their own AI efforts. Because AI is just some niche area that they can ignore.
Just as Battlemage GPUs were getting decent reviews and sold above the MSRP.