News for hackers. Stuff that matters.
Re:Detecting Chrome headless, the game goes on by pault on Friday July 19, 2019 @07:56PM (#20483363)
When I'm doing personal scraping, I just write a chrome extension. You can find boilerplates that are super easy to set up, and they persist in a background thread between page loads. It's really easy to collect the data and log it in the console or send it to a local API or database. It's the lowest effort method of scraping I know, and you can monitor it while it runs to make sure it doesn't get hung up on some edge case.

There are no comments on this comment yet.