Re:SETI@home Is in Hibernation
by acjacobson on Saturday March 18, 2023 @05:35AM
(#35207596)
If bandwidth wasn't a limiting factor would it be worth it or still make sense to use big machines onsite?
If bandwidth wasn't a factor, the first rearchitecture that I think would make sense is to do most of the processing in a single datacenter somewhere. Having one datacenter in West Virginia, one in South Africa, one in New Mexico, one in the California mountains, it introduces a lot of overhead. The systems naturally drift their configurations over time, and nothing is quite as "write once run everywhere" as you'd like.
So we have to do most of the processing on site.
AI training is similar but not quite so extreme - when you try to use a bunch of consumer machines, bandwidth becomes the limiting factor.