Big-cap tech is utterly notorious for some of the worst anti-trust violations and other cartel-style behavior of any sector. This goes back as least as far as “Wintel” in the 90s and probably further that I didn’t watch up close. Suffice it to say that the Justice Department is extremely disincentivized to go after domestic economic Cinderella stories in a globally competitive world and has had to bring lawsuit after lawsuit on everything from bundling to threatening OEMs to flagrant wage fixing in print (I do have second-hand that the mass layoffs are coordinated aka Don’t Poach 2.0).
Crippling “gaming” (high margin but not famine-price gouging margin) cards, controlling supply tightly enough to prevent the market clearing at MSRP routinely, stepping at least up to and likely over the line on the GPLv2: these things or things like them have been ruled illegal before (though it’s hard to imagine that happening again).
It’s possible that tech is just a natural monopoly and we had it right with Ma Bell: innovation was high, customer prices were stable and within the means of most everyone, and investors got a solid low-beta return.
It’s easy to view the past with rose-colored glasses and the Bell Era wasn’t perfect, but IMHO this status quo is worse.
A market failure is a market failure.
There’s a big lobby on HN who want to defend or minimize or justify leaving market failures be, which is weird given they’re really bad for most people on HN, it’s a free country.
But let’s call it what it is.
They made a good product. The competition is responding too slowly. And they got lucky with this crazy (in a good way) AI boom. I don't see how this could possibly be outlawed or why you would even want to. It will resolve itself on its own given enough time.
The government as a big costumers could demand these things, even without having a low. The military should demand these things to be open for various reasons.
I think Nvida can still make plenty of money in such a world.
In cases where an interface has absurdly high value for society if its a standard, the government could also 'buy' that and open it up. Just like they do with other infrastructure.
One could make the argument that the x86 interface should be public domain as it amounts to infrastructure that most of society builds on. How such a thing would exactly work is of course up for some debate. But the concept of the government 'liberating' common interfaces makes sense from a society perspective.
How would that have stopped Nvidia from dominating the AI market?
>The government as a big costumers could demand these things, even without having a low. The military should demand these things to be open for various reasons.
I agree that governments should use APIs with multiple competing implementations (or one truly open source implementation) where possible. This could make a difference in some cases, but I doubt it would have had a big impact in this particular case as demand for GPGPU is overwhelmingly coming from the private sector.
>In cases where an interface has absurdly high value for society if its a standard, the government could also 'buy' that and open it up. Just like they do with other infrastructure.
Agreed, but is there a legal reason why AMD and others are not allowed to create a clean room implementation of CUDA? Haven't they done exactly that with ZLUDA (which they have now defunded)?
I thought not supporting CUDA was more like a failed strategic move by competitors to prevent CUDA from becoming an industry standard.
I think we agree on all the relevant principles. I just don't see how any of these principles make a big difference in this particular case.
Also, I don't see the Nvidia situation as particularly problematic. They are not too entrenched to unseat. Some of their biggest customers (themselves huge oligopolists) are shaping up to be their biggest competitors.
Most of AI processing will be inference, not training. Bringing the costs down is absolutely key for broad AI use. My bet is that the hardware margins will end up being slim.
The likely height of big-cap tech regulation was the regulated monopoly of ATT/Bell Labs/Western Digital all through the 20th century.
I prefer the outcomes in that era to the present status quo.
You can agree or disagree, and disagreeing is simple: “I prefer these outcomes because…”. I welcome such disagreement. And FWIW I’m not one of the many people who downvoted you: but they were justified in doing so because you moved a comparison of policies and their outcomes into a more abstract space of 1-bit generalizations, e.g. “talking points” vs “law/precedent”. I gave examples, it’s public record and trivially Googleable.
You didn’t fail to understand my point, you didn’t like it and took a cheap shot.
Let me (start to) Google that for you:
https://www.sec.gov/enforce/sec-enforcement-actions-fcpa-cas...
https://www.justice.gov/atr/antitrust-case-filings-alpha
https://www.csoonline.com/article/567531/the-biggest-data-br...
https://www.cnbc.com/2023/01/24/doj-files-second-antitrust-l...
https://www.channele2e.com/news/big-tech-antitrust-regulator...
https://www.nytimes.com/2019/07/23/technology/justice-depart...
... scads more law stuff and a decade ...
https://en.wikipedia.org/wiki/High-Tech_Employee_Antitrust_L...
... scads more law stuff and a decade ...
https://en.wikipedia.org/wiki/United_States_v._Microsoft_Cor....
And I never mentioned 'not citing concrete examples.', if your confused about the ask, I'll repost it: "can you write a credible argument based on known case-law/precedent/etc... "
i.e. Can you write down the actual argument that you propose to advance?
The de-facto mechanism that's occurring with market segmentation is that consumers pay less than the clearing price and enterprises pay more. And consumers benefit from this subsidy.
If you banned it, you also wouldn't change the cost of developing new generations of products, so product development just would go slower, and the market would get even lumpier and less efficient (vendors squatting newer nodes would have an advantage, but it's inefficient to launch something immediately to compete with them, etc).
Price discrimination is generally prohibited in naked form: it often if not usually induces market failures. So companies spare no expense working around it (there's a reason why ITA software people made a mint approximating NP-hard problems acceptably well and rather cheaply to compute airplane ticket prices).
"Market segmentation generally benefits consumers" is exactly the kind of Wien's Law first-order approximation that sounds compelling but doesn't fit the data.
It does not benefit consumers that a 4090 has the same amount of GDDR6 in it as a 3090, which is incidentally 2.6Gb shy of `dolphin-8x7b-v1-q4_k_m` (or whatever the NVIDIA equivalent is, I use Apple gear now because inference is the game now), while the price of that RAM dropped. The fact that an H100 or whatever the next Hopper iteration is costs more than an M-series BMW on paper says nothing about what Meta paid for 150k of them or whatever it was, and it certainly doesn't help someone who'd like a decent chat bot without sending their data to eyeball-scanner database guy. When you see a leading edge x090 for MSRP or less at Best Buy, it's a good idea to stock up if you're in the market over the last 5 years (London has been running ETH2 for what, a year and change now?). That hardly seems a subsidy to the consumer paid for by those spendthrifts in FAANG.
NVIDIA pioneered serious "GPGPU" engineering. 5-10 years ago their microarch and fab-sourcing and software and the whole show were legitimately differentiated, no one had done it. And they made a pile, and that pile seems "conflict-free". But anyone can make a fused multiply-add unit these days, EE undergraduates do it in Verilog. Intel makes PCI express cards that cost $300 and have higher memory bandwidth in the <hand-wave>decoder-only language attention model</hand-wave> use case. And their drivers are documented and work on everything.
Now did Lisa Su decide to "concentrate on the supercomputing market with the MI300XYZ" and Jensen decided to "concentrate on AI with Hopper" independently to a degree where the market is perfectly partitioned? Who knows, I certainly don't have proof one way or the other. But if someone made a call being like "I'm thinking of focusing on X but don't really see our differentiation in Y. How's Cathy?", it wouldn't be the fucking first time.
But even that isn't critical to the point: this, the here and now, isn't good for consumers, or society, or our industry, and unlike e.g. Stallman's melodrama, it fucking matters this time.
Levity aside, unfortunately this stuff is as real as Tuesday and taxes, and as serious as a heart attack used to be and an off-color tweet is now. This is the "Star Trek: TNG" v. "Blade Runner 2024" moment: for the first time in history the endless cycle of tennis courts and guillotines and eventually a new crop of nepotism-fueled classism awaiting its turn at the guillotine might end up in a spontaneously broken symmetry.
There are like 5-10 unanimous markers of human achievement that machines can trivially reproduce or exceed, and everyone acknowledges Chess and Go and Atari and fan-fiction and ImageNet and ImageNet fan-fiction are in that box.
But think about what an LLM actually does:
`argmax(P(next_token | {previous_tokens, corpus, joint_alignment_loss, epsilon}))`
They're human in a really scary sense: there's an old saying that if you can only be good at one thing, be good at lying, because then you're good at everything. LLMs beat pick-up artists in bars and tech CEOs in all-hands meetings all to hell at vaguely riffing with a ruthless, amoral, and narrow goal. If I ask Dolphin to talk like a VC? It says "path-dependent" every third sentence like it's got a Substack and a Tesla and a very respectable 3-bedroom in Los Gatos or Atherton.
If this stuff was floating around 20 years ago? We'd throw out the donor class without a second thought on seeing that a MacBook can talk like any power-broker but better.
Today? The capture is so far along that we might end up handing the reigns of "alignment" over to "effective altruists", at which point the situation is pretty static.
I still don't see the required effort put into place by Intel together with AMD in order to create an attractive alternative to CUDA.
Right now they're only only getting looks because their devices are cheaper for the hardware you get and for big projects because they're available, so you're required to have in-house experts who know how these platforms work in order to get stuff done that you know would definitely work on Nvidia.
The games Nvidia is playing with the consumer market is really annoying, but we have to thank Intel and AMD that Nvidia is in a position to do this. Microsoft is probably also at fault.
We're at a point where Apple only has to say "Oh, one more thing, you can now put Nvidia GPUs in your Mac Pro" for Intel and AMD to notice in what position they've put themselves into.
Half those teams are full of crap, a quarter will take the funds and try to do something like CUDA (but better) cough ROCm. Then another eighth to a quarter will simply not have the political clout to get the whole thing done.
Add to this that we just funded 10 teams to get 1-2 functional teams… and you see why chasing after an incumbent is hard. Even when you have near infinite money to do so.
Developers valued their own development experience, features, and performance over value, efficiency, portability, openness, or freedom. The result is anyone depending on CUDA became vendor locked to Nvidia. Similar as the story with Direct3D, though thankfully there are workable solutions for D3D now implemented on top of Vulkan. Nvidia's CUDA moat may be less fordable.
It's a reimplementation of cuda on top of rocm, and it's a drop in replacement you can use with already compiled binaries. It's even faster than native rocm/hip in blender
Intel is weak, and it’s much smarter to put resources into squeezing Intel while they are on the ropes than shift too much focus to ML.
Things like Bumpgate as a major social media mindshare thing largely stem from him and his coverage. And he leaves off the part where AMD gpus were failing too (because of the same RoHS-compliant solder) and where apple kinda wanted to part ways anyway because they saw the “platform” nvidia was building and didn’t want any part of it on macOS… game knows game.
That’s the problem is like the evga thing there is a distinctly contemporary take and that’s shaped by people like Charlie, and then there’s the take with the benefit of a couple years of hindsight and maybe it wasn’t exactly the way the bunny man predicted. Maybe apple didn’t want CUDA usurping them, and maybe apple wanted to leave the way clear for the pivot to apple silicon and metal and the platform Apple wanted to build there.
https://blog.greggant.com/posts/2021/10/13/apple-vs-nvidia-w...
The problem is the AMD fanboys are just as noxious today and - just like the evga thing - it’s gonna take years before people are willing to re-evaluate things fairly.
https://www.reddit.com/r/nvidia/comments/xgn7do/we_need_more...
https://youtu.be/vyQxNN9EF3w?t=5044
There’s a little backstory like this behind almost all of the AMD fanboy “lore” around nvidia. Crysis 2 was never a thing either - the whole point of wireframe mode is seeing the full geometry at maximum LOD, with no culling, for example. nvidia never “sold directly to miners”, tech media didn't actually read the RBS article they were citing and it doesn't say what they say it says. NVIDIA "said they're completely an AI company now" was 2015. Etc. There's just a group of people who just get off on hating and they don't mind making shit up if that's what it takes.
It's essentially impossible to unwind the popular opinion of NVIDIA from this ridiculous amount of past-hate... yeah, after 20 years of blood libel they probably do have an overall negative public opinion! People know the stories are true, because NVIDIA is bad, because there's all these stories, so they must be true.
They were in the same ballpark until the past coupld of quarters. Nvidia laid the groundwork for this ages ago by developing drivers that play nice with NN.
AMD could easily have done the same at the time, and can do so now.
Even if it costs $1b-$10b to do it, AMD can afford it and it’s worth doing. They’ve got $55b in equity, and a huge $280b market cap to issue more stock into. [https:valustox.com/AMD]
They're releasing APUs with tensor cores right now.
They're finally getting their dogshit ROCm drivers fixed right now.
Yes, they're late. But they're definitely playing. This whole "asleep at the wheel" thing may have been true a year ago, but it's not true now.
[edit] Apologies, responded to the wrong comment, but I'll leave it here anyway.
AMD has a looooong history of seemingly deliberately shooting themselves in the foot every time they get ahead.
https://www.cnbc.com/2023/12/06/meta-and-microsoft-to-buy-am...
https://www.tomshardware.com/news/amd-scores-two-big-wins-or...
https://www.tomshardware.com/tech-industry/artificial-intell...
“Oracle is set to use…”
“Elon Musk implies…”
Not one of them have actually bought anything. AMD is just muddying the waters by grouping HPC sales with AI. It’s nonsense.
Edit: I see you’ve got a startup on MI300x hardware. Now it makes sense, I guess - you need to believe. Good luck!
Or maybe I know things you don't. =)
AMD isn't shipping in large volume yet, but MI300x instances can be spun up in preview on Azure today with availability ramping up. Microsoft has absolutely bought a lot of MI300x.
You really should disclose that you’re a founder when you mention your company like that
Don't die on this hill, just do the decent thing and add a disclosure. This doesn't show you in a good light.
There is nothing in the guidelines or faq on this topic. So, it is best that we conclude that you are making up some fake rule that you expect people to abide by and then claiming a weird superiority complex about how I am looking bad according to your made up rules.
I do not need to tolerate that.
Classic HN… getting downvoted by the silent minority. Would love to see how you deal with bullies.
To quote Bill Burr roasting Apple, there's a bit of "Einstein - Gandhi - Me" going on, but its way below the threshold for identifying themselves as a founder, IMO.
"Please don't use HN primarily for promotion. It's ok to post your own stuff part of the time, but the primary use of the site should be for curiosity."
I was not "talking up" my company. I made a reference to it, by name, on a relevant thread. This is well within the guidelines.
This disclosure thing ain't a biggie to do
And yes, yours was an instance of self-marketing, even if unintentional, by name-dropping your company alongside power players like Meta and Tesla. You put yourself on people’s radar as a GPU-intensive company.
"Please don't use HN primarily for promotion. It's ok to post your own stuff part of the time, but the primary use of the site should be for curiosity."
What I posted, just the name of my company, was entirely within the bounds of common courtesy.
Of course, I do want to put myself on people's radar... I am building a GPU-intensive company and I'm making a small relevant comment on a thread.
I looked it up. Over the years, there has been endless bike shed discussion on this topic, such as:
https://news.ycombinator.com/item?id=24353959
https://news.ycombinator.com/item?id=36404027
I think that it is smart of the moderators here to simply sit on the sidelines and not try to control the discussion of this too much.
You think AMD doesn't want to carve out a chunk of that pie?
What Nvidia is doing is hard and the engineers with the skill to design those chips are few far between. I'm sure Nvidia's already hired most of the best in the business.
Anyone who wants to unseat Nvidia will need very talented people, who aren't cheap, and that means massive investment capital which largely doesn't exist.
The thing that is missing is AMD focusing their software engineers that develop the drivers, and making them put work into RoCM to make it usable across all cards, all driver versions, like with NVIDIA.
However, the real killer feature now is CUDA. Everyone's coding for CUDA, which AMD's hardware doesn't support, so even if they have a GPU that's on par with Nvidia, most libraries still can't make full use of it.
the trajectory looks good if they can just resist giving up early without seeing instant success
Sounds like I've been doing life wrong.
Intel may end up back on top.
https://www.asml.com/en/news/press-releases/2022/intel-and-a...
https://www.datacenterdynamics.com/en/news/intel-receives-it...
https://www.tomshardware.com/tech-industry/manufacturing/tsm...
>EDIT: bro, you're the one that said corporations are mobile, not me
I say it and you misunderstand it. Mobile as they can open an office in any country, not move the HQ alltogethere.
It doesn't have to be a race to the bottom
The bait and switch.
This is true. It's like blaming the company for being successful. "Stop making products that are so much better than any other product".
I'm not sure we want that?
If Android were superior, no one would care what Apple did. Everyone would simply use Android.
I think the conversation around side loading and store royalties on iOS has more to do with who owns the hardware, and what the user is permitted to do by the manufacturer.
So what? "Any company with a monopoly" would also pay children in company scrip to work 20 hours a day in unsafe factories unless compelled to do otherwise.
Without going practically all-in on Zen, they'd be bankrupt.
But the only reason you're mad at Nvidia is because they made something desirable (a GPU that does NN training) but didn't do it in the way you prefer (NVLink, Linux compatibility etc).
It's not their fault AMD and others have been asleep at the wheel and handed them the whole market for free. Any company with a monopoly on the hot new thing would try to capitalize on it.
When the other GPU makers eventually catch a wakeup, the situation will finally improve.