Intel is also well known for inking long-term deals with major discounts for big customers (Google, Facebook, etc.) that can commit to purchasing large amounts of hardware, whereas Nvidia doesn't really have the same reputation. It's conceivable that Intel could use this strategy to help bootstrap their server GPU business. The Googles and Facebooks of the world are going to have to evaluate this in the context of how much additional engineering work it is to support and debug multiple GPU architectures for their ML stack, but thinking long-term/strategically these companies should be highly motivated to negotiate these kinds of contracts to avoid lock-in and get better discounts.
How many of us learned ML using Compute Sticks, OpenVINO and OneAPI or another of their libraries or frameworks, or their great documentation? It's like they didn't really believe in it outside of research.
What irony is it when a bedrock of "AI" fails to dream?
Language models in particular are very similar architectures and effectively a lot of dot products. And running them on GPU's is arguably overkill. Look at llama.cpp for the way the industry is going. I want a fast parallel quantized dot product instruction on a CPU, and I want the memory bandwidth to keep it loaded up. Intel should be able to deliver that, with none of the horrible baggage that comes from CUDA and nvidia drivers.
I'm thinking about the widespread confusion they caused by having different CPUs support different subsets of the AVX-512 ISA.
Now while NVidia is making standard C++ run on CUDA, Intel is still having SYSCL and oneAPI extensions.
Similarly with Python and RAPIDS framework.
Intel and AMD have to up their game for the same kind of developer experience.
SYCL isn't pure C++, meaning writing STL code that goes into the GPU, like CUDA allows for, nor requires the hardware to follow C++ memory model.
Nope. Intel doesn't get "It's the software, stupid."
Intel is congenitally unable to pay software people more than their engineers--and they treat their engineers like crap, mostly. And they're going to keep getting beaten black and blue by nVidia for that.
The more disappointing thing for me is that they bought like 5 AI startups pretty early on and have basically just shut most of them down. Maybe that was always the plan? See which ones develop the best and consider the rest to be acqui-hires? But I think it's more likely just fallout from Intel's era of flailing around and acquiring random crap.
For a company that makes a truckload of money from selling CPUs it's unforgivable their tools are not
a) free
b) top-notch
I know one is limited by how good Windows is when you ship a tool for Windows, but your description is quite horrifying.
They just bad at it.
Some of the wafer fabs are in the US, but most of assembly gets done in Malaysia
https://en.wikipedia.org/wiki/List_of_Intel_manufacturing_si...
I suppose one unknown catalyst with intel is what happens in taiwan/china. If things get crazy over there, suddenly intel seems alot more valuable as the 'US' chip maker (they produce roughly 75% in the US iirc). If the gov starts to even more heaivly subsidize non-reliance on asia, intel could find major gains if TSMC/samsung get shut out.
I mean, just look at the market caps- Intel is worth 6x less than nvidia despite historically having the same or greater gross revenue (not counting the most recent quarter of course).