News for hackers. Stuff that matters.

throwawayasdasd

Ask HN: Advanced web crawling resources?

Does anyone know any good resources for advanced web scraping (scraping at scale, getting around various tricks to prevent crawling, etc.)?I've looked around a lot but nearly all resources I find are the same. A short description, a small code snippet and that's it.I'm really looking for more.

( Read More... | 10 comments | 39 points | on HN )