News for hackers. Stuff that matters.

Show HN: caniscrape – Analyze anti-bot protections before scraping (CLI and Web)

https://github.com/ZA1815/caniscrape

I built this after hitting an infinite loop pagination trap on Newegg and wasting hours building a scraper that never had a chance.

caniscrape analyzes a URL and tells you: - What protections are active (WAF, CAPTCHA, rate limits, TLS fingerprinting, honeypots) - Difficulty score (0-10) - What tools/approach you'll need

Install: pip install caniscrape Usage: caniscrape https://example.com Web version: https://caniscrape.org

NOTE: Very hard sites like Amazon or YouTube will show as 0 because their bot protections are essentially invisible, I will fix this in a future update.

NOTE FOR WEB VERSION: The web version uses a cloud IP which is blacklisted by major sites. I will add proxy rotations to defeat this but for now, the website is only good for easy/medium sites.

( 2 comments | 2 points | on HN )
Re:Show HN: caniscrape – Analyze anti-bot protections before... by yohskar on Wednesday October 22, 2025 @05:13PM (#45675202)
Very nice
Re:Show HN: caniscrape – Analyze anti-bot protections before... by Crroak on Wednesday October 22, 2025 @05:13PM (#45675211)
Thank you!