News for hackers. Stuff that matters.

A comment on Scrape like the big boys. Parent comment

Re:Scrape like the big boys by scarygliders on Friday November 05, 2021 @12:38PM (#29121647)
And yet...

> We've once had to scrape Amazon product pages because they have a lot of API endpoints, but those didn't contain the data we needed.

...only a couple of comments up.

[ Parent | on HN ]
Re:Scrape like the big boys by weird-eye-issue on Friday November 05, 2021 @09:54PM (#29126826)
You don't know what data they needed. Maybe they needed reviews or product descriptions. The API doesn't cover everything but it does cover the exact use case I was replying to.
[ Parent | on HN ]