Ask HN: Advanced web crawling resources?
Does anyone know any good resources for advanced web scraping (scraping at scale, getting around various tricks to prevent crawling, etc.)?I've looked around a lot but nearly all resources I find are the same. A short description, a small code snippet and that's it.I'm really looking for more.