Re:Show HN: Tgfeed – convert public Telegram channels into R...
by badmonster on Friday May 02, 2025 @12:00AM
(#43866075)
what's the best way to scale scraping-heavy services like this without getting blocked?
[ Parent
| on HN ]
Re:Show HN: Tgfeed – convert public Telegram channels into R...
by nDmitry on Friday May 02, 2025 @04:50AM
(#43867550)
It depends on how their owners protect them. Switching IPs via proxies and changing user agents are well-known and relatively simple methods—essentially pretending to be different clients. However, nowadays, services like Cloudflare often render these techniques obsolete, forcing you to mimic human behavior instead. I don’t have expertise in that area.
Re:Show HN: Tgfeed – convert public Telegram channels into R...
by vladkens on Friday May 02, 2025 @10:32AM
(#43870319)
You can read any public Telegram feed in your web browser at the URL: t.me/s/CHANNEL_NAME. So far it doesn't look like a problem with scrappe telegram feeds now. Unlike Reddit / X.