News for hackers. Stuff that matters.

A comment on A path to O1 open source. Parent comment

Re:A path to O1 open source by elorant on Friday January 03, 2025 @06:51PM (#42590783)
How is China training models without access to cutting edge GPUs?
[ Parent | on HN ]
Re:A path to O1 open source by ryao on Friday January 03, 2025 @07:33PM (#42591028)
They have access to cutting edge GPUs via rentals:

https://www.msn.com/en-us/money/markets/bytedance-plans-to-s...

[ Parent | on HN ]
Re:A path to O1 open source by pixelesque on Friday January 03, 2025 @07:16PM (#42590920)
They're being more efficient about it by the looks of things, rather than brute-forcing things...

https://x.com/karpathy/status/1872362712958906460

[ Parent | on HN ]
Re:A path to O1 open source by rajamaka on Friday January 03, 2025 @07:37PM (#42591050)
The same way drug users access illegal drugs.
[ Parent | on HN ]
Re:A path to O1 open source by kristjansson on Friday January 03, 2025 @07:01PM (#42590833)
Pretty easily, it turns out?
[ Parent | on HN ]
Re:A path to O1 open source by arthurcolle on Friday January 03, 2025 @09:04PM (#42591625)
very carefully
[ Parent | on HN ]
Re:A path to O1 open source by HarHarVeryFunny on Saturday January 04, 2025 @10:33AM (#42595300)
- using non-cutting edge GPUs (just more of them)

- creating more efficient models such as MoE based DeepSeek

- getting their hands on cutting edge GPUs all the same

I think it was Dylan Patel (from semianalysis) on Dwarkesh that mentioned one scam is for a Chinese source to arrange for a SOTA NVidia cluster to be bought/installed in some non-embargoed country, then dismantled and shipped to China.

[ Parent | on HN ]