Larrabee is one such product. It wasn't immediately great, and didn't immediately promise great returns, and didn't quite have a market yet, so it was killed. I can't imagine where Intel would be in the AI world if they had the foresight to stick with Larrabee.
Somehow they forgot that all of their highly profitably businesses were risky bets at one time.
Good on them for sticking with their promises for firebase. But it’s a pity about stadia. Don’t bet your business on a flip of the Google coin.
And that all of their highly profitable businesses are risky bets long term.
[0] https://brightsideofnews.com/blog/an-inconvenient-truth-inte...
In an absolute best case scenario, he may be right.
But that seems incredibly unlikely.
Still, they should’ve had a much MUCH better GPU story than they did.
I think Cantrill spelled it out in the article, and I think people are overlooking (and for some reason really continue to overlook, or just have no idea) that nvidia's advantage is Software.
I remember Larabee as a teenager - I just graduated high school, the forums were talking about it, and I had finally saved enough money to buy an 8800GTX. The 8800GTX was also coincidentally, the first consumer GPU to support CUDA. Almost 2 decades later and it feels like nvidia has an insurmountable moat in AI due to CUDA. This wasn't an accident, nvidia spent a ton of time, with developers, getting it right. FTA:
>that NVIDIA had an indisputable lead, even in 2009; that for Intel to dominate NVIDIA it would have required conjuring software expertise and focus with which Intel has famously struggled
Ignoring this piece is huge in claming that nvidia would be a quarter of the size. Can you even imagine Intel investing in a non-x86 developer platform for 15 years while they were in the lead?
You’re dead right that Nvidia is where they are because of their software story and all the work they put into it.
I don’t know if Intel could have learned that lesson.
Intel invented this model with x86.
And more recently, the reviews I read of the Archmage graphics drivers didn't make it sound like Intel had understood the importance of the software that was essential to a pretty big hardware release.
AI hasn't cared about Cuda for years - sure, Torch on NV will use it, but AI is all about Torch/TF, not details below that.
This was, if anything, the main theme at Supercomputing: “there is not even a point in talking about Nvidia’s new benchmarks. You all are going to buy it anyways” coupled with very few “we are betting on buying cheap hardware (Intel/AMD GPUs) and hope that we can build the relevant parts of CUDA ourselves” and the latter is pretty much a desperation move of labs/sites that simply cannot get NVIDIA GPUs (either price or availability).
And yes that is probably the seed of the end of Nvidia’s dominance. But it will take 20 years and multiple fuck ups. Just as it did with Intel
This could be 100% true, and the best ML engineers in the world could be completely oblivious to CUDA and it wouldn't change why nvidia is leading right now.
Anyone who thinks it's "trivial" to use AMD cards should help geohot and his tinygrad boxes. Despite emailing the CEO several times, it was a clear uphill battle to get something working, and even now the sales page lists driver quality as "mediocre".
If you open a GitHub issue or a forum post about your weird CUDA application that isn't working right, you will have an engineer help you. This is in nvidia's DNA and they did this before AI started printing money. On the flipside, you can email Lisa Su today and still not have problems fixed in AMDs drivers. I'm sure AMD is trying, this isn't to say they aren't, but having decent software culture at these large companies is hard.
If AMD can't do it, I feel even less confident about Intel. If the CUDA moat truly didn't matter, we would see AMD cards in demand. However it doesn't and it isn't for lack of trying.
That doesn’t mean, that ML people don’t care about some hardware specifics btw. Of course they do! Because CUDA is very, very good at exploiting the specific features of the newer cards (I’ve forgotten, what exactly this was though). But take away the simple integration into their favorite AI-SDK and it would be completely irrelevant.
The point is just that, if Intel were to build strictly better hardware, but not provide the interface to torch, then they would still loose to Nvidia. Yes, yes, this is not completely true. Given enough advantage someone else would build the IntelCUDA. But this is literally the bet that those academics make. And it’s so risky, that only academics are doing that
In an infinite universe, anything can happen, and so "it might not work" is is always true for everything. No matter what you do, it might not work, and some of the most important and valuable things ever aren't attainable without a lot of investment before you can start to reap any return.
Not all ideas are good ideas, so of course there are reasons not to do some things, or to abandon something you started, but merely "what if it never works" is not one.
Asking that is about equal to asking what if a piano falls on you tomorrow. Sure it could happen, but so what? What does that change? If you don't walk down the street for fear of pianos, you don't get to the grocery store or your job and then you die from starving instead of from a piano.
You need to remember that was during the financial crisis, and the first chips were going to be laughably bad and uncompetitive. From the quote in that article:
> Justin Rattner (Intel Senior Fellow) demonstrated Larrabee hitting one teraflop, which is great but you could walk across the street and buy an ATI graphics board for a few hundred dollars that would do five teraflops.
Intel had no chance for v0 to do anything but lose money. They were way off track, and spent most of the time trying to get to a software rasterizer plus hardware that could work for some games.
They did pivot Larrabee into the various Knight chips (Knights Corner, Landing and whatever else) since the "it's just x86" was a pretty compelling story in the 2009 era. But ultimately, HPC wasn't that great a market in the early 2010s for accelerators yet and NVIDIA ended up totally eating their lunch over time.
I think Intel could have stuck with the HPC market and gotten lucky once ML exploded, but realistically until about 5 years ago there wasn't that much ML spending yet either. 10 years of last place discrete GPU work would have been difficult to invest in.
tl;dr: the business case for Larrabee hinged on having a successful gaming business and it wasn't even close.
If Intel had been practising making discrete GPU from 2009 to 2024 instead of giving up then it does seem quite reasonable that Nvidia would be a quarter of its size. One of the obvious mis-steps Intel made over the last 20 years was failing to keep trying Larrabee-style chips until they figured out how to make them work. Ok version 1 might be a disaster and version 2 might be bad. But we're looking back over almost 20 years! There was a lot of room to figure out how to be good and tap in to the huge new market that was opening up.