Ask HN: What are the best tools for web scraping in 2022?

Re:Ask HN: What are the best tools for web scraping in 2022? by dkthehuman on Wednesday August 10, 2022 @10:15AM (#32412331)

I built a tool called Browserflow (https://browserflow.app) that lets you automate any task in the browser, including scraping websites.

People love it for its ease-of-use because you can record actions via click-and-point rather than having to manually come up with CSS selectors. It intelligently handles lists, infinite scrolling, pagination, etc. and can run on both your desktop and in the cloud.

Grateful for how much love it received when it launched on HN 8 months ago: https://news.ycombinator.com/item?id=29254147

Try it out and let me know what you think!

[ Parent | on HN ]

Re:Ask HN: What are the best tools for web scraping in 2022? by vitorbaptistaa on Wednesday August 10, 2022 @12:29PM (#32414637)

It looks amazing! Great intro video.

It probably doesn't make sense for Browserflow as a business, but I'd love to find a tool like this that exported a Scrapy spider, similar to the now unmaintained Portia.

[ Parent | on HN ]

Re:Ask HN: What are the best tools for web scraping in 2022? by statmapt on Wednesday August 10, 2022 @10:54AM (#32413030)

Browserflow fan here - I used it on a variety of projects. DK was a great help throughout the way on the slack group.

It's fun to watch his twitter and celebrate his wins alongside him

[ Parent | on HN ]

Re:Ask HN: What are the best tools for web scraping in 2022? by dbecks on Wednesday August 10, 2022 @11:45AM (#32413940)

Beautifully done! Really amazing tool.

[ Parent | on HN ]