News for hackers. Stuff that matters.
Re:Show HN: Crawlee – Web scraping and browser automation li... by lloydatkinson on Tuesday August 23, 2022 @08:39AM (#32564004)
Looks great! Just wondering why it has a few scrapers built in - like puppeteer and cheerio. Is it because you might want headless only sometimes?
Re:Show HN: Crawlee – Web scraping and browser automation li... by mnmkng on Tuesday August 23, 2022 @10:15AM (#32565249)
Yeah, exactly. Using pure HTTP needs much less resources than running headless browsers, so unless you really need to use a browser, you can save a lot of compute power (and money) by using plain HTTP.