News for hackers. Stuff that matters.
Re:Show HN: Peer-to-Peer data transfer tool based on libp2p by rakoo on Saturday February 13, 2021 @01:03PM (#26125281)
Having a distributed search engine is far from easy (there's the main issue of trust in the index). It's possible to do it the other way around, thanks to DHT scraping being allowed: everyone can scrape the peers and build an index at home, with tools like magnetico (https://github.com/boramalper/magnetico) for example
Re:Show HN: Peer-to-Peer data transfer tool based on libp2p by the8472 on Sunday February 14, 2021 @06:26AM (#26131417)
Afaict magnetico is a selfish implementation. It takes resources from the network but doesn't provide any back. If everyone ran that at home instead of a proper DHT node then the network wouldn't work. That said, it used to be far worse (actively polluting others' routing tables) and it's nice seeing BEP51 validated as a proof of concept.
Re:Show HN: Peer-to-Peer data transfer tool based on libp2p by rakoo on Sunday February 14, 2021 @12:49PM (#26134387)
Not the author of magnetico here.

I think magnetico is not expected to replace a proper DHT node but be run in parallel: one is naturally present because you're a peer in any amount of torrents, the other is using the network for searching. I'd expect both to be running on the same machine.

After a few weeks of running it I know have a 2.6GiB database of torrents. I wouldn't expect a standard torrent node to include this feature, especially because the value of magnetico only comes when the database is big enough.

That said magnetico should definitely be a standard node in the network, it's light enough that it can do it

Re:Show HN: Peer-to-Peer data transfer tool based on libp2p by capableweb on Sunday February 14, 2021 @01:42PM (#26134888)
> That said magnetico should definitely be a standard node in the network, it's light enough that it can do it

Maybe in the future. As things are right now, magnetico is a huge bandwidth eater and will literally eat all available bandwidth if it can, doesn't seem to have any limits setup today so if you want to be able to do other things at the same time, you have to limit the process/IO manually.