Is there a source for this? I googled it and this was claimed to be satire

Not really tbf, it's an extrapolation. As far as I am concerned, there is growing concern, with Anthropic coordinated lobbying against open weights. The point I am making is we need strong Hardware actors consistently standing for hardware neutrality and integrity. Historically, NVIDIA has been very pro open weights. But at the same time, in-silicon guardrails seem to become the new thing: https://news.ycombinator.com/item?id=49879883

Makes you wonder what would happen if the US ever wanted to enforce "certified US AI" on its chips

I'm curious how effective something like that would really be.

Nvidia can certainly put up some guardrails that will sound impressive to the dinosaurs in Congress, but can it really stop China from using those GPUs anyway?

This is a simplification, but is this not in some way similar to how the Switch 1 has hacked due to a design flaw on Nvidia's Tegra chip?

In the same way, even if their GPUs get this protection, wouldn't a state actor figure out how to get around it?

The entire article that thread references never mentions any hardware, at all, only their software platform. The "Watchdog" referred to in the (editorialized?) title is literally never mentioned, and it is not really a piece of "hardware", it is a piece of _software_ called "Sentry" that (clarified in the Nvidia blog) they run on Bluefield-4 hardware (the "chip") which is their network card. It only exists in $10mil+ clusters. Just an awful and misleading article and headline, and an awful thread filled with people who know nothing about how hardware works arguing over nothing.

Most of the hardware functionality from a GPU that models need is generic and used every time you use a GPU for any compute. You can implement language models in a GLSL shader; modern GPUs have been programmable for 20 years, that's the point of their existence. The best thing they could do is just literally nerf the consumer hardware substantially to make tokens unusable or stop selling consumer hardware. They don't need spyware to do that.

More broadly, "Compute" is basically a resource that our economy relies on to a large degree, it has been that way for decades. And it turns out it's very bad when you just destroy the thing your economy relies on. And doing so doesn't solve problems like "Current computers exist today" or "Other people make computers". So who gives a shit about Jensen? Comments here talking about "taking him out"? What's actually more likely is just that really powerful people today are often corrupt and also really fucking stupid. He played a stupid game and lost.

Nothing is putting the current open weights genie back in the bottle IMO, maybe except Amodei using RoboStormtrooperGruppen9000 bots and going door to door to take peoples GPUs at gunpoint.

Yeah, this is the biggest concern that I have regarding this whole story.

It's obviously the biggest concern.

Either through technical means, or simpler: by law for American providers. It's hard to believe the administration was not aware of Jensen's affiliations all this time. And time is pressing for Anthropic and OpenAI.

Only conjectures for now, time will tell

Definitely, expect future GPUs to run only signed LLM models with mandatory online attestation and reporting.

> I hope this won't change NVIDIA's refusal to block inference..

lol had to read this several times due to all the negatives

finally got it - "I hope NVIDIA continue to allow inference..."

Wow. Finally found a human in the comments

Of course it will. That's the entire point of this. It has nothing to do with an affair.