Re:BitTorrent Turns 10: Happy Birthday
by zitterbewegung on Saturday July 02, 2011 @07:00PM
(#2722629)
Wouldn't it be better to split up the datafiles for each node? Unless do you need a copy of the whole dataset?
Underlying this is a desire for ad hoc computation, where the calculations to be performed don't have to be decided in advance. (Presumably this is also what Carmack means by "computation of opportunity".) You can't do this if you have to collect the data first. But if you know where the data already is, you can send the computations to it. It seems like the BitTorrent protocol would help here.