How we scrape 300k prices per day from Google Flights

Re:How we scrape 300k prices per day from Google Flights by sneak on Saturday June 13, 2020 @03:07PM (#23511829)

> E.g. telling exactly which ASN this traffic would be arriving from

The article mentions that they are using rotating residential proxies.

[ Parent | on HN ]

Re:How we scrape 300k prices per day from Google Flights by jsnell on Saturday June 13, 2020 @03:10PM (#23511853)

Ah, thanks! I missed that part in the writeup.

[ Parent | on HN ]

Re:How we scrape 300k prices per day from Google Flights by fsaintjacques on Saturday June 13, 2020 @03:23PM (#23511946)

There's a very high chance this is monetization of botnets, which adds even more to the overall shadyness.

[ Parent | on HN ]

Re:How we scrape 300k prices per day from Google Flights by dylz on Saturday June 13, 2020 @04:40PM (#23512513)

This is almost certainly guaranteed to be either monetization of botnets, or inadvertently installed adware.

[ Parent | on HN ]

Re:How we scrape 300k prices per day from Google Flights by fxtentacle on Saturday June 13, 2020 @03:10PM (#23511848)

Why would they need those proxies if what they are doing is fully legal?

[ Parent | on HN ]

Re:How we scrape 300k prices per day from Google Flights by asciident on Saturday June 13, 2020 @03:18PM (#23511913)

You do know that "legal" means "against the law" right? And when you say something is illegal, then you need to produce the law it violates; there's no proof from a company trying to prevent you from doing it.

[ Parent | on HN ]