News for hackers. Stuff that matters.
Re:Interesting Interview with DeepSeek's CEO by ricardobeat on Tuesday December 31, 2024 @08:07PM (#42563131)
Models like Llama 3 are trained on sixteen thousand GPUs, OpenAI probably 25k-100k GPUs. This is the kind of scale the sanctions make a lot harder to achieve.
Re:Interesting Interview with DeepSeek's CEO by sangnoir on Tuesday December 31, 2024 @08:14PM (#42563164)
> This is the kind of scale the sanctions make a lot harder to achieve

Harder and more expensive, but far from impossible. I doubt they pay more than doubles Nvidia's sticker price, all told. Nvidia got into legal trouble recently for paying lip-service to sanctions - id you're keen on the mechanics of GPU sanctions-busting, read up on the governments accusations against Nvidia, and this was for low-hanging fruit.

The article has one analyst speculating they used tens of thousands of H100s (50,000 IIRC) instead of the 10,000 A100s the Deepseek CEO owns up to. They can afford to pay exorbitant markups for the logistical nightmare of importation through 3rd party countries at scale.

Re:Interesting Interview with DeepSeek's CEO by seanmcdirmid on Tuesday December 31, 2024 @10:30PM (#42563749)
That really sounds plausible. They could open a training farm in Vietnam or Mongolia (or even Taiwan, or really anywhere the internet goes) and just use it, the GPUs don’t need to be located in the mainland. The only way to lock down the GPUs would be to just restrict completely to who could use them, and then prevent them from contracting with sanctioned entities.

When I was working in Beijing, we definitely had resources we couldn’t access locally but could easily access remotely so it didn’t really matter.

Re:Interesting Interview with DeepSeek's CEO by blackoil on Wednesday January 01, 2025 @12:23AM (#42564150)
Singapore, Taiwan and South Korea are closeby and large+stable enough to easily create such data centers. Small batches for experimentation by team can be easily smuggled. China is too large and powerful to be completely sanctioned.
Re:Interesting Interview with DeepSeek's CEO by e_y_ on Wednesday January 01, 2025 @05:36AM (#42565199)
The Information claimed today that ByteDance is renting GPUs in the cloud, although ByteDance denies it (well, they call it "inaccurate" which is not exactly a strong rebuttal).

https://www.tomshardware.com/tech-industry/artificial-intell...

Re:Interesting Interview with DeepSeek's CEO by csomar on Tuesday December 31, 2024 @11:18PM (#42563918)
You are under-estimating the powers of the “black market”. North Korea and Cuba are shithole countries because their governments are shit and not solely because of sanctions.

If you follow the news, several people (bankers) will trade with Iran despite the repercussions (jail) of doing so. There is a premium but at the right price someone will execute.