News for hackers. Stuff that matters.

A comment on The State of Web Scraping 2022. Parent comment

Re:The State of Web Scraping 2022 by emptysea on Wednesday January 12, 2022 @10:48AM (#29908015)
Is the “pretty optimized headless browser” an off the shelf thing, or something custom? Are you using playwright/puppeteer to drive it?
[ Parent | on HN ]
Re:The State of Web Scraping 2022 by mycall on Wednesday January 12, 2022 @11:09AM (#29908425)
Headless Chrome [0] and alpine-Chrome [1] are pretty popular. Some variations also include V2Ray, Shadowsocks and other VPNs.

[0] https://hub.docker.com/r/justinribeiro/chrome-headless/

[1] https://github.com/Zenika/alpine-chrome

[ Parent | on HN ]
Re:The State of Web Scraping 2022 by rozenmd on Wednesday January 12, 2022 @11:10AM (#29908450)
There are plugins for Puppeteer: https://github.com/berstend/puppeteer-extra/tree/master/pack...
[ Parent | on HN ]