News for hackers. Stuff that matters.
Re:Show HN: Crawlee – Web scraping and browser automation li... by mvolfik on Tuesday August 23, 2022 @05:58AM (#32562544)
Thank you! And exactly as you say, using the same language as the websites gives us some advantages - we have HTTP-only (no client-side JS) crawlers based on the Cheerio library, which mimics jQuery API, and if you later find out that you need to use a full headless browser with Puppeteer, you can just call the utility function injectJquery, and there's very little you have to modify to keep your script working

There are no comments on this comment yet.