Show HN: Headless Chrome Crawler

Re:Show HN: Headless Chrome Crawler by hartator on Thursday February 22, 2018 @10:42AM (#16438279)

Thanks. Wish it was simpler. It seems overkill to have to an extra proxy in the middle with no auth to authenticate with the one with auth, just to make headless chrome working.

[ Parent | on HN ]

Re:Show HN: Headless Chrome Crawler by timstapl on Thursday February 22, 2018 @11:00AM (#16438466)

There's also page.authenticate, which has worked well for me. https://github.com/GoogleChrome/puppeteer/blob/master/docs/a...

[ Parent | on HN ]

Re:Show HN: Headless Chrome Crawler by jancurn on Thursday February 22, 2018 @11:00AM (#16438469)

You can also use page.authenticate() for that - see a note at the bottom of the article. Also see https://github.com/GoogleChrome/puppeteer/pull/1732

[ Parent | on HN ]