How about in their own datacenter? Perhaps they didn't ship the H200s, but instead offered remote cloud compute services to Chinese customers which happened to include H200s. I don't know how you would prevent this exactly- the US would have to tell Singapore that it's companies can not sell cloud services to China if they are using H200s?- it's not really Nvidia's problem.
US government only figuring out recently would be astronomically incompetent. So not unlikely. However lobbyists would have obviously brought this up long ago.
The export controls did not constrain manufacturing in of these systems in China or China's purchasing of compute (from Amazon for example) running on these chips. Chinese entities in a third country were legally able to purchase the chips and deploy that compute in the third country.
This is effectively the intelligence sector showing it still has teeth left now that Trump has lost a lot of his power.
If you remember, there was a lot more anti China sentiment during the previous Democrat gov, as pushed by the intelligence establishment.
You mean the Biden administration? They were heavily anti-China, yes, but that was mostly just a continuation of Trump I's anti-China policies. The big policy shift happened between Obama and Trump.
You would expect that knowledge to include a breakdown between sanctioned and non-sanctioned GPU models.
You would really expect them to know the largest foreign importer (Megaspeed) was a really just a front for Alibaba.
You would expect the company to at least make this very clear sometime around 2024 when US regulators were already aware of all the above.
What more can I say, if you really believe they didn't knowingly evade sanctions, and probably with complicitity from the US Admin., I have a bridge to sell you.
It wasn't illegal to sell GPUs to china. It depends on _which_ GPUs they were selling, and I haven't seen any reporting that identifies specifically which models were found in Megaspeed's possession. If the had 600,000 H200s in their closet, it wasn't illegal.
And while the US was allowing certain chips to be exported, China wasn't allowing their companies to buy them (although they definitely trained on them in data centers outside of China). That could account for why they're in storage and not deployed.
Also, it's entirely possible that the board didn't fire him and he resigned because there are a bunch of other women and he doesn't want his family to suffer the embarassment of more of them being revealed.