News for hackers. Stuff that matters.
Re:Microsoft introduces its own chips for AI, with eye on cost by solardev on Wednesday November 15, 2023 @04:00PM (#38282416)
Is there not a distributed computing potential here like there was for crypto mining? Some sort of seti@home/boinc like setup where home users can donate or sell compute time?
Re:Microsoft introduces its own chips for AI, with eye on cost by fragmede on Wednesday November 15, 2023 @04:08PM (#38282506)
you can setup a computer and sell time on it on a couple of saas platforms, but only for inference. for training, the slowness of the interconnect between nodes become a bottleneck.
Re:Microsoft introduces its own chips for AI, with eye on cost by solardev on Wednesday November 15, 2023 @04:09PM (#38282531)
I see, thanks for the explanation!
Re:Microsoft introduces its own chips for AI, with eye on cost by latchkey on Wednesday November 15, 2023 @04:08PM (#38282504)
The capex/opex is different for ML/AI than it was for crypto mining. Totally different hardware profiles.
Re:Microsoft introduces its own chips for AI, with eye on cost by brucethemoose2 on Wednesday November 15, 2023 @04:43PM (#38282975)
Yes, see projects like the AI Horde and Petals. I highly recommend the Horde in particular.

Theres also some kind of actual AI crypto project that I wouldn't touch with a 10 foot pole.

But ultimately, even if true distribution like Petals figures out the inefficiency (and thats hard), it had the same issue as non Nvidia hardware: its not turnkey.