Re:Show HN: Privacy-focused, ad-free, non-tracking torrent s...
by TuringTest on Wednesday January 18, 2017 @12:41PM
(#13428370)
How large is the database compiled by Magnetissimo? Is it Wikipedia-sized (a few dozens of Gigabytes), or several orders of magnitude above or below?
Re:Show HN: Privacy-focused, ad-free, non-tracking torrent s...
by sergiotapia on Wednesday January 18, 2017 @01:14PM
(#13428676)
Haven't really measured to be honest. But it's only 1 model with a few fields. Shouldn't be humongous.
It's easy to build a crawler, the hard part is spending time on bullshit like DMCA takedowns and such. Even if you say: "I just crawl, I don't provide download links, I don't even know what is indexed", you have to deal with legal issues.
So, host your own locally or for your community. No big deal.
Even Google has to deal with DMCA!