News for hackers. Stuff that matters.

A comment on How we learnt to stop worrying and love web scraping. Parent comment

Re:How we learnt to stop worrying and love web scraping by forgotmypw17 on Wednesday September 09, 2020 @08:33PM (#24427643)
I think the solution is "hybrid" scraping with a human driving the clicks and the scraper passively collecting the data.

If you record, you can probably teach AI to emulate.

[ Parent | on HN ]
Re:How we learnt to stop worrying and love web scraping by extremeMath on Wednesday September 09, 2020 @08:52PM (#24427764)
I love this. I might try it. It doesn't scale, but that's okay for my project.
[ Parent | on HN ]