News for hackers. Stuff that matters.
Re:BitTorrent Site Magnet Database Archives Available via To... by gaius_baltar on Saturday May 21, 2022 @06:01PM (#31462351)
Let's not forget one of the best approaches for indexing magnet hashes: https://btdig.com . It basically connects to the DHT and listens to queries. When a new one is found, it downloads the torrent data and indexes it.
Re:BitTorrent Site Magnet Database Archives Available via To... by r3trohack3r on Saturday May 21, 2022 @09:05PM (#31463885)
DHT work is fun - you can scrape a lot of interesting content. BitTorrent and Tor both use DHTs for content discovery.

If you’re interested in building a minimum viable scrapper, this is a good reference: https://github.com/retrohacker/Taboo/blob/main/lib/index.js

The trick to content discovery on the DHT is to parrot any incoming request you receive. So if someone asks for a hash or announces a hash, you turn around and ask for that hash too. You can spin up multiple DHT nodes to increase your coverage of the table.

Some cool user experiences can be built off of this. I’ve discovered a tonne of interesting content using “BitTorrent Roulette” applications that download random hashes from the DHT - often times finding fascinating content from languages I don’t speak.

Re:BitTorrent Site Magnet Database Archives Available via To... by KennyBlanken on Saturday May 21, 2022 @11:20PM (#31464600)
"BitTorrent Roulette" sounds like a wonderful way to end up with child porn on your computer.
Re:BitTorrent Site Magnet Database Archives Available via To... by CyanBird on Saturday May 21, 2022 @11:55PM (#31464758)
Are people still so naive as to use torrent for that?

Well I'd guess I might be the naive, given the ample amount of honey pots and such

Re:BitTorrent Site Magnet Database Archives Available via To... by r3trohack3r on Sunday May 22, 2022 @03:59PM (#31472127)
I’ve found that, no, they aren’t.

The ratio of this content on the DHT is so incredibly low you’re very unlikely to pull it. I never have, and I’ve resolved a metric tonne of random torrent hashes.

You do find content labeled as such - but it’s either password protected rars (I suspect the password is to remove plausible deniability? Idk what’s inside these rars, I obviously don’t have the password and I immediately shred them when they do fall out of the roulette wheel - I’m not interested in trying to break into them) or a honeypot with a government agency video advertising a support hotline. I’ve noticed a government in LatAm has a lot of honeypot content on the public BitTorrent DHT. It’s a guy sitting at a desk in front of the state flag advertising an anonymous support hotline.

I have, however found some ethically questionable things. Dumps of credit card info, sus military schematics written in an Eastern European language, etc.

Ethics aside - if you live in the United States, more than 90% of what falls out of the Roulette Wheel is going to be strictly illegal because of copyright law. Downloading random hashes from the DHT is not something I’d suggest doing from a computer that can easily be traced back to your identity. I summarize this in the README of Taboo: https://github.com/retrohacker/taboo

Re:BitTorrent Site Magnet Database Archives Available via To... by LeoPanthera on Saturday May 21, 2022 @07:14PM (#31463072)
Wow, thank you for that. That's very clever and very useful.

It's a shame they use recaptcha, it's means it's impossible to script searches with something like Jackett.

Re:BitTorrent Site Magnet Database Archives Available via To... by e12e on Saturday May 21, 2022 @07:28PM (#31463193)
well, you could run your own instance: https://github.com/btdigg-org/dhtcrawler2
Re:BitTorrent Site Magnet Database Archives Available via To... by tn1 on Sunday May 22, 2022 @01:51AM (#31465232)
Am I missing something or is the source not actually available in that repo? I only see the compiled .beam files
Re:BitTorrent Site Magnet Database Archives Available via To... by maybe_pablo on Sunday May 22, 2022 @02:36AM (#31465476)
Source code is available under the “src” branch.
Re:BitTorrent Site Magnet Database Archives Available via To... by simongray on Sunday May 22, 2022 @07:48AM (#31467108)
what a strange way to use git
Re:BitTorrent Site Magnet Database Archives Available via To... by e12e on Sunday May 22, 2022 @10:56AM (#31468867)
> This git branch maintain pre-compiled erlang files to start dhtcrawler2 directly. So you don't need to compile it yourself, just download it and run it to collect torrents and search a torrent by a keyword.
Re:BitTorrent Site Magnet Database Archives Available via To... by LeoPanthera on Saturday May 21, 2022 @07:34PM (#31463245)
Ah, that is perfect. Thank you.
Re:BitTorrent Site Magnet Database Archives Available via To... by vinibrito on Saturday May 21, 2022 @07:21PM (#31463126)
Well, one can write a bot that defeats recaptcha. Trivial, once you know what to do.
Re:BitTorrent Site Magnet Database Archives Available via To... by LeoPanthera on Saturday May 21, 2022 @07:23PM (#31463152)
If "one" can write a bot that defeats recaptcha, what is the point of recaptcha? I think extraordinary claims require extraordinary evidence.
Re:BitTorrent Site Magnet Database Archives Available via To... by derefr on Saturday May 21, 2022 @08:40PM (#31463739)
I presume by "defeat" they mean "use one of the libraries that allows you to pay $0.10 for each query, to route your CAPTCHA to people in developing countries who will solve them for you." Which is economically viable for individual use-cases, but still economically unviable for spambots.
Re:BitTorrent Site Magnet Database Archives Available via To... by Fnoord on Sunday May 22, 2022 @07:21AM (#31466951)
It is much cheaper than 0,10 USD per captcha.
Re:BitTorrent Site Magnet Database Archives Available via To... by shitlord on Sunday May 22, 2022 @12:51AM (#31464975)
Another technique is to enable the accessibility mode, which is a speech-to-text prompt and is supposedly easier to bypass.
Re:BitTorrent Site Magnet Database Archives Available via To... by colecut on Saturday May 21, 2022 @08:04PM (#31463494)
It would still limit "most" =p
Re:BitTorrent Site Magnet Database Archives Available via To... by zenincognito on Saturday May 21, 2022 @08:53PM (#31463814)
Spot on!
Re:BitTorrent Site Magnet Database Archives Available via To... by metadat on Saturday May 21, 2022 @07:24PM (#31463155)
Badass. Thank you sir, madame, or they.
Re:BitTorrent Site Magnet Database Archives Available via To... by marci on Saturday May 21, 2022 @07:55PM (#31463425)
> sir, madame, or they

Neither, I think it's a cylon.

Re:BitTorrent Site Magnet Database Archives Available via To... by metadat on Saturday May 21, 2022 @08:21PM (#31463594)
I am assembling the grand mac daddy of all magnet link dbs / seeding systems. If you want to subscribe to updates or are otherwise interested please reply here so I can gauge interest. Will post to HN when ready. This is bigger than piracy, it's about free flow of information over time for humanity.

I am up for collaborating and sharing.

Re:BitTorrent Site Magnet Database Archives Available via To... by jazzyjackson on Saturday May 21, 2022 @08:27PM (#31463643)
your default /var/www/html/index.html is showing ;)
Re:BitTorrent Site Magnet Database Archives Available via To... by marci on Sunday May 22, 2022 @09:08AM (#31467769)
Did I stumble upon a cylon hive?
Re:BitTorrent Site Magnet Database Archives Available via To... by metadat on Sunday May 22, 2022 @11:43AM (#31469369)
Look left, look right. It appears so.
Re:BitTorrent Site Magnet Database Archives Available via To... by squarefoot on Sunday May 22, 2022 @04:37AM (#31466108)
> https://btdig.com

First hint suggested: "interracial gangbang"

They might want to put those hints behind a NSFW warning; just my .2c.

Re:BitTorrent Site Magnet Database Archives Available via To... by killingtime74 on Sunday May 22, 2022 @04:40AM (#31466126)
Anyone who has spent more than 5 minutes in torrent-land has seen NSFW
Re:BitTorrent Site Magnet Database Archives Available via To... by jokoon on Sunday May 22, 2022 @05:42PM (#31473103)
that link doesn't work