News for hackers. Stuff that matters.
Re:Notes on Writing Web Scrapers by cushychicken on Thursday December 02, 2021 @05:04PM (#29423387)
Interesting question. My first instinct is to say that woob seems closer in use case to a browser than a scraper, as it seems largely geared towards making rich websites more easily accessible. (If I'm reading the page right, anyway.) A scraper is basically just hitting a web page over and over again, as fast as you can manage.

The trick, IMO, is to be closer to browser level loading on a server than scraper. Make sense?

There are no comments on this comment yet.