Re:Pirate Library Mirror: Preserving 7TB of books (that are ...
by stavros on Monday July 04, 2022 @05:35AM
(#31975212)
My idea is similar but slightly different. You'd run your client and then choose whose provider's data to seed, eg you'd add the Internet Archive and Libgen to your datasets.
Only those entities would be able to push data to you, nobody else, so if you trust the providers you specified, you should be good.
Re:Pirate Library Mirror: Preserving 7TB of books (that are ...
by npteljes on Monday July 04, 2022 @10:36AM
(#31977494)
I remembered that I read about something like that before. I think this was it: https://en.wikipedia.org/wiki/Storage@home
Further this lead me to distributed data stores: https://en.wikipedia.org/wiki/Distributed_data_store#Peer_ne...
https://en.wikipedia.org/wiki/Freenet
Regarding of how easy to make something like this network, I'd wager it's pretty hard. There will be a lot of questions, even while establishing the happy path, for example how you manage the updates, especially when you update the protocol, not just the software, and how you effectively manage the volume of search requests, how you distribute the files etc.
And then there's the abuse the network will inevitably get. How you handle spammers, CSAM, malware, ISPs that throttle/block you, the legal risk you put your clients up to, etc. Nice big can of worms. To begin opening it, I suggest a reading through Wikipedia's Peer to peer file sharing article, and especially the File sharing modal on the right, which nicely captures the ideas that have been tried so far.
https://en.wikipedia.org/wiki/Peer-to-peer_file_sharing