News for hackers. Stuff that matters.
Re:How Retailers Use Personalized Prices by baxtr on Sunday October 22, 2017 @04:04AM (#15525698)
I have been thinking about that exact service for a while. One big issue is that you need the reverse engineer the pricing models of retailers, i.e. mapping out a high-dimensional space. For that you need a lot of data from the retailers. They could probably ban you quickly if you start pulling price quotes en masse. Then you need to invest a lot in cloaking techniques etc.
Re:How Retailers Use Personalized Prices by crdb on Sunday October 22, 2017 @04:32AM (#15525763)
You don't. At least we didn't.

Here's the real problem:

1. modern shopping sites are built haphazardly without structure;

2. a typical page load time is 10-20 seconds for many (most?) shops.

1. matters because you cannot build a simple crawler. This is because sometimes, the brand is in the title, the description is in the brand, and the gender is in the quantity, which itself is in the photo as a pixellated image...

You must load the entire page and figure out where the attributes are in a smart way. You can do this today with headless chrome, in the old days with Selenium, etc.

... which brings us to 2. A mainstream, regionally-dominating shop, particularly any that adopt the marketplace model (Amazon, Taobao, etc.) may have as many as 20 million products. Given 2., good luck refreshing this price list in a sane time, even if you crack the attribute extraction.

If by some miraculous feat you solve these issues you now have to product match an inventory of billions of listings, most of which are misspelt, missing attributes (brand, etc.), and use photos that even a human could not match by sight. Think how hard it is to find exactly what you want on eBay...

The only way is to get the data directly from the retailers. Assuming they will give it to you, you end up with the same problem of feed poisoning that you have with marketing.

Re:How Retailers Use Personalized Prices by baxtr on Sunday October 22, 2017 @04:49AM (#15525791)
Oh one thing you could do: Create a huge community of users who share their purchase data and other data.and then build the model through that died so if you want to participate and save you need to be part of the panel
Re:How Retailers Use Personalized Prices by zild3d on Sunday October 22, 2017 @12:04PM (#15527410)
> 2. a typical page load time is 10-20 seconds for many (most?) shops.

That sounds very exaggerated, are you quoting this range from actual data?

For a sanity check the first two shops that came to mind loaded in <3 seconds (guitarcenter.com, nike.com)

Re:How Retailers Use Personalized Prices by dclowd9901 on Sunday October 22, 2017 @02:42PM (#15528245)
Funny, I had a lot of overlap in this kind of smart data quantizing when I was trying to build a venue page crawler that would intelligently mete out live music event dates, times and locations. I realized about 20% into the project I'd need some form of machine learning and then bailed.
Re:How Retailers Use Personalized Prices by baxtr on Sunday October 22, 2017 @04:43AM (#15525777)
Oh wow, so it’s far worse than I thought. So the only way is to best-guess pricing models?
Re:How Retailers Use Personalized Prices by digitalengineer on Sunday October 22, 2017 @10:40AM (#15527023)
You’re over-thinking it, I think. All you need to do is provide a service that makes the E-commerce website think you’re not a big spender: geo: live in a poorer neighborhood, and age/gender/preferences must be the most optimal for you not them. Each experience (as they call it was pre-defined and pre-build).
Re:How Retailers Use Personalized Prices by TheCoelacanth on Sunday October 22, 2017 @01:32PM (#15527883)
Except it's not necessarily that simple. They are also probably taking into account your ability to seek out other options.

Researchers found that black women were getting cars sold to them at a much higher markup than white men. I doubt that is because they were getting profiled as wealthier.

Re:How Retailers Use Personalized Prices by gruez on Sunday October 22, 2017 @02:30PM (#15528179)
how are you going to hide your shipping address? by using reshipping services?
Re:How Retailers Use Personalized Prices by maksimum on Sunday October 22, 2017 @03:31PM (#15528479)
You only provide the shipping address once you've been given a price quote.
Re:How Retailers Use Personalized Prices by hobofan on Sunday October 22, 2017 @04:22AM (#15525744)
You can go an uncloaked route and offer customers that buy the product with an usual profile small cashbacks if they provide you with their data.
Re:How Retailers Use Personalized Prices by edem on Sunday October 22, 2017 @04:18AM (#15525729)
We can have TensorFlow do it...one model to rule them all...there will be neural networks fitting retailers, then there will be adversarial networks deployed by retailers, then NCMs (network counter measure)... the price will be high, since more and more will be consumed by the networks, then as an emergent behavior Skynet will rise and it will launch the missiles...
Re:How Retailers Use Personalized Prices by baxtr on Sunday October 22, 2017 @05:41AM (#15525912)
What about blockchain technology? That would sure help, too...
Re:How Retailers Use Personalized Prices by alkonaut on Sunday October 22, 2017 @07:39AM (#15526302)
Once the deep learning blockchains are on quantum computers this will all be easy