That's a useful performance improvement but it's incremental progress in line with what new models often improve over their predecessors, not in line with the much more dramatic reduction they've achieved in training cost.

If H800 is a memory-constrained model that NVIDIA built to avoid the Chinese export ban on H100 with equivalent fp8 performance, it makes zero sense to believe Elon Musk, Dario Armodei and Alexandr Wang's claims that DeepSeek smuggled H100s.

I feel like a fraud for telling people that DeepSeek could've smuggled chips once I took a look at the actual DeepSeek optimizations. The only reason why a team would allocate time on memory optimizations and writing NVPTX code rather than becoming much better at posttraining is if they severely struggled with memory during training.

I mean, take a look at the numbers:

https://www.fibermall.com/blog/nvidia-ai-chip.htm#A100_vs_A8...

This is a massive trick pulled by Jensen, take your best chip that's regulated by the government, find which specs are required for the regulations and then make a weaker clone that bypasses one of the specs.

What's surprising is anyone would repeat Elon musk related things.

Tech or politics related, he's off the deep end.

Especially since he seems intent on everyone talking about him all the time. I find it questionable when a person wants to be the centre of attention no matter. Perhaps attention is not all we need.

Yet another casualty of laypersons browsing arXiv. That paper was like flypaper to his narcissism.

The problem is he's only wrong some of the time and then people arguing about which one it is this time generates attention, a valuable commodity.

He's like a broken smart network switch, smart as in managed. Packets with switch MAC on it are all broken, but erroneously forwarded ones often has valuable data. We through L3 don't know which one is which.

Maybe “some” applied in the past but his recent history might best be described as “almost always”.

Drugs. Dont do that much drugs for so long.

I'm wrong some of the times.

He's a lucky mensch, no more, no less.

Interesting how people keep calling it “the Chinese export ban”. Isn’t an American export ban?