News for hackers. Stuff that matters.
Re:Ask HN: What are the best tools for web scraping in 2022? by shireboy on Wednesday August 10, 2022 @11:53AM (#32414091)
I have had some luck running puppeteer in a nodejs app hosted at glitch.com. I spring for the (cheap) paid hosting and get several containers for dev/test/prod, web based ide. Obviously, this would only scale to a point. In my case I just need a single client automating interaction with a single site. If I really needed scale, I'd probably use one of the services listed elsewhere.

Of course, if you don't need a full javascript-enabled browser parse, consider alternatives first: simple HTTP requests, API, RSS, etc.

Re:Ask HN: What are the best tools for web scraping in 2022? by david_databar on Wednesday August 24, 2022 @10:35AM (#32580001)
Why don't you set it up on databar.ai? Or is it a more complex use case