News for hackers. Stuff that matters.
Re:Mac at Any Scale by egorfine on Tuesday November 03, 2026 @02:08PM (#50356669)
Also: which solution you have chosen for the p2p deployment? I used to manage deployments on a large scale cluster and got it down from 2h to <1m using libtorrent.
Re:Mac at Any Scale by nichtverstehen on Tuesday November 03, 2026 @02:19PM (#50356834)
Yeah, as alluded to in the post, we have a custom p2p distribution, very inspired by BitTorrent. So you're on the right track :). We'll probably share more on that topic at some point too.

But honestly before we had that, we started with a system where nodes pulled whole images from each other (a decentralized algorithm without central coordination, but no chunking). It worked surprisingly well considering how simple the implementation was.