News for hackers. Stuff that matters.
Re:Why scraping and ecommerce are a perfect fit by sradu on Wednesday November 12, 2014 @07:59PM (#8599371)
Tom, that most likely wasn't us.

We don't spider retailer websites. That means we don't follow links or go hardcore on building a database of products.

We hit your website:

* if someone has asked us information about a product url

* when we place an order

* weekly for regression tests

Ping us on contact@ and we're more than happy to jump on a call and describe exactly what we're doing. Most of the time we're completely un-noticeable except for the fact that you're getting more orders.

We know for sure nobody is spidering through us.

Re:Why scraping and ecommerce are a perfect fit by tommccabe on Wednesday November 12, 2014 @08:13PM (#8599413)
thanks for the confirmation. how do you get the product URL in the first place?
Re:Why scraping and ecommerce are a perfect fit by razvanr on Wednesday November 12, 2014 @08:20PM (#8599433)
That's the app developer's responsibility.
Re:Why scraping and ecommerce are a perfect fit by Jake232 on Wednesday November 12, 2014 @09:36PM (#8599629)
Is there any caching that goes on here? I would presume not as the vendors prices could change prices / details at any point.