Re:Microsoft introduces its own chips for AI, with eye on cost
by solardev on Wednesday November 15, 2023 @04:00PM
(#38282416)
Is there not a distributed computing potential here like there was for crypto mining? Some sort of seti@home/boinc like setup where home users can donate or sell compute time?
[ Parent
| on HN ]
Re:Microsoft introduces its own chips for AI, with eye on cost
by fragmede on Wednesday November 15, 2023 @04:08PM
(#38282506)
you can setup a computer and sell time on it on a couple of saas platforms, but only for inference. for training, the slowness of the interconnect between nodes become a bottleneck.
Re:Microsoft introduces its own chips for AI, with eye on cost
by solardev on Wednesday November 15, 2023 @04:09PM
(#38282531)
I see, thanks for the explanation!
Re:Microsoft introduces its own chips for AI, with eye on cost
by latchkey on Wednesday November 15, 2023 @04:08PM
(#38282504)
The capex/opex is different for ML/AI than it was for crypto mining. Totally different hardware profiles.
Re:Microsoft introduces its own chips for AI, with eye on cost
by brucethemoose2 on Wednesday November 15, 2023 @04:43PM
(#38282975)
Yes, see projects like the AI Horde and Petals. I highly recommend the Horde in particular.
Theres also some kind of actual AI crypto project that I wouldn't touch with a 10 foot pole.
But ultimately, even if true distribution like Petals figures out the inefficiency (and thats hard), it had the same issue as non Nvidia hardware: its not turnkey.