Re:Show HN: OpenFaaS template for headless Chrome and Puppeteer
by abc03 on Tuesday January 05, 2021 @05:29PM
(#25652100)
Just discovered your article “Introduction to web testing and scraping” and will try it out. Exactly had the problem of scaling last time I tried out to run several headless browser. Thanks for this!
[ Parent
| on HN ]
Re:Show HN: OpenFaaS template for headless Chrome and Puppeteer
by alexellisuk on Wednesday January 06, 2021 @03:49AM
(#25655855)
Do you mean https://www.openfaas.com/blog/puppeteer-scraping/ ?
There are more traditional tools and SaaS services based around the web-driver model, which might be useful for folks who don't want to get into infrastructure, and don't want the latency of using Lambda. In testing I saw 15s+ for visiting a simple website that took 1-2s locally in a container.
Feel free to give the content a try and let us know how it goes for you? OpenFaaS can also run these tasks async and queue them up / process from a queue.