Re:Show HN: Crawlee – Web scraping and browser automation li...
by lloydatkinson on Tuesday August 23, 2022 @08:39AM
(#32564004)
Looks great! Just wondering why it has a few scrapers built in - like puppeteer and cheerio. Is it because you might want headless only sometimes?
[ Parent
| on HN ]
Re:Show HN: Crawlee – Web scraping and browser automation li...
by mnmkng on Tuesday August 23, 2022 @10:15AM
(#32565249)
Yeah, exactly. Using pure HTTP needs much less resources than running headless browsers, so unless you really need to use a browser, you can save a lot of compute power (and money) by using plain HTTP.