Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by fc417fc802 on Wednesday June 24, 2026 @07:48PM
(#48666934)
I think generally you have to be very conservative about how you use ultra cheap hosts like hetzner simply due to the economics. Either find a more expensive service that will exert more effort towards discretion or alternatively spend $5 per month on a VPN that's friendly to torrents.
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by farnsworthfusor on Wednesday June 24, 2026 @08:46PM
(#48667363)
I heard the more money you're paying them the more lenient they are.
For cheap hosts look for ones that allow tor exit nodes if you're looking for ones that allow funny stuff. There are some that allow it for ideological reasons. Look through the hundreds on lowendtalk. On that forum you can even ask the providers directly if they allow it.
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by k4rli on Wednesday June 24, 2026 @05:46PM
(#48666004)
Runs fine at home. I've indexed 20M+ torrents in last few months running it during the day. With Prowlarr (or similar) it could easily replace other indexers.
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by NoMoreNicksLeft on Wednesday June 24, 2026 @06:00PM
(#48666123)
Which magazines?
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by qingcharles on Wednesday June 24, 2026 @06:43PM
(#48666476)
Anything I don't have! Sometimes I'll find a torrent and no seeds/peers and I'll wonder if there is another torrent out there that has the same files in it somewhere that I can find.
The other day it was trying to track down some older High Times issues that were torrented but the torrent is dead. Last night it was a mag titled Films & Filming which I know is scanned, but I can't find anywhere.
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by toomuchtodo on Wednesday June 24, 2026 @07:04PM
(#48666645)
Can I get a copy for the Internet Archive? Will take as much of the corpus as you’re willing to provide.
(no affiliation with them)
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by qingcharles on Thursday June 25, 2026 @12:31AM
(#48668911)
I'm starting to upload everything very soon. I have >4million magazines here so far I think. Feel free to email me on my profile :)
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by HugoTea on Thursday June 25, 2026 @08:16AM
(#48672263)
Do you have old 2000s era Argos catalogues?
Argos is a shop in the UK, I've been tracking down old catalogues to see if my childhood CD player is in there, can't find evidence of it anywhere and so many were made.
The catalogues are sort of rare but were given away for free, now people sell old ones on ebay
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by qingcharles on Thursday June 25, 2026 @11:49PM
(#48682133)
I don't, but I've started a separate project to try and collect as many catalogues as possible, Argos included. I'm after a Maplin catalogue from my youth :) I do remember coming across a site with a bunch of Argos catalogues on it, but I suspect if you've done any searching you came across that site already?
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by NoMoreNicksLeft on Wednesday June 24, 2026 @08:48PM
(#48667382)
High Times is mostly on archive.org, if you need that one. I'd sort of like the film-making one, I'll put some time into that. On my list of periodicals, I think the count's up to 500 that I consider important enough to archive and I'm nowhere near done with it.
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by qingcharles on Thursday June 25, 2026 @12:32AM
(#48668922)
Yeah, I have the High Times from archive.org, but it's missing a lot of issues which were torrented at some point. If there's anything you need send me an email on my profile.
Re:Crawling BitTorrent DHTs for Fun and Profit [pdf]
by NegativeLatency on Thursday June 25, 2026 @12:11AM
(#48668783)
yes but with a VPN to my seedbox, all the egress from the docker containers its running in goes through this: https://github.com/passteque/gluetun
the seedbox is through https://www.feralhosting.com used them for over 10 years now and they've been great (shared hosting so I have linuxbrew setup there, but no docker sadly)
I built one with a nice TUI to run on a VPS so I can try and find rare magazine torrents, but Hetzner were upset about it. I need to find it a new home. It was a very good citizen, but it still raised too many flags.