Re:Show HN: Crawlee – Web scraping and browser automation li...
by aaronyarborough on Tuesday August 23, 2022 @11:09AM
(#32566021)
Looks pretty cool. I'm working on a project that relies on regularly scraping large amounts of data. My codebase uses nodejs, and I'd love to try out a few of the features listed under "Helpful utils and configurability" as they might be able to solve a few pain points I have.
[ Parent
| on HN ]
Re:Show HN: Crawlee – Web scraping and browser automation li...
by mnmkng on Tuesday August 23, 2022 @11:16AM
(#32566140)
Nice! Good luck with your project. The parsers are available under the utils.social namespace: https://crawlee.dev/api/utils/namespace/social The headless browser utils are under puppeteer and playwright utils https://crawlee.dev/api/puppeteer-crawler/namespace/puppetee...