Re:Puppeteer Or: How I Learned to Stop Worrying and Love the...
by yen223 on Thursday April 02, 2020 @11:27PM
(#22766084)
Tip: When inspecting an element in the devtools, you can right-click the element and select Copy > CSS Selector (in Firefox) or Copy > Copy selector (in Chrome) to grab the selector to that element.
Re:Puppeteer Or: How I Learned to Stop Worrying and Love the...
by tracker1 on Thursday April 02, 2020 @07:59PM
(#22765115)
Browser automation isn't always strictly for testing... sometimes you need to perform a couple actions, to do a little scraping in order to facilitate an integration between two systems you don't control.
I really like puppeteer because it's generally much faster and more responsive than selenium and other alternatives I've used. Also, it's crazy easy to pass an async function, and it will serialize and run it on the client browser and return the result to you in your automation script.
If you're familiar with JS, it's so much closer to second nature in terms of the types of control you can acheive.
[0]: http://autify.com/
I have some infrequent scraping tasks for personal that hit a recaptcha at most once an hour, and are not time sensitive and can be retried later.
I would really love to find a way, that when the scraper hits a recaptcha, I get somehow notified and can solve it by hand (remotely).
However, the only solutions I’ve found up to date were paid recaptcha solvers
I really like puppeteer because it's generally much faster and more responsive than selenium and other alternatives I've used. Also, it's crazy easy to pass an async function, and it will serialize and run it on the client browser and return the result to you in your automation script.
If you're familiar with JS, it's so much closer to second nature in terms of the types of control you can acheive.
Yes. For example you can automatically create gif animations using puppeteer... see https://gif.com.ai