News for hackers. Stuff that matters.
Re:How your data is collected and commoditised via “free” on... by hodwik on Wednesday March 16, 2016 @04:21PM (#11300379)
He's on the right track, but absolutely wrong about where the bulk of this data comes from.

It's not shady "Take a free trip!" websites.

It's your Dominoes Pizza order, it's your trip to Target, it's everything you do. (A sales person for one of the big companies listed those specific groups, but said it was basically everyone.)

The big companies in the industry (LexisNexis, Thompson Reuters' CLEAR) buy everyone's data. Anything they can get their hands on.

As far as I can tell, everyone in the country's data is being stored; everywhere you have ever lived, all of your phone numbers, voting records, debts, legal history, marriages, past names and aliases, email addresses, everything.

It's all in a handful of huge private systems. Systems that were originally marketed to law enforcement agencies, but are now being shopped to private companies as well. Insant CheckMate is just a tiny tiny fraction of what is actually captured by these data brokers.

Source: You'll have to take my word for it.

Interesting tidbit -- They have alerts setup in the system; E.g. if you search for the wrong person you'll get a call from headquarters asking why you're pulling up Kanye West's home phone number, etc.

Re:How your data is collected and commoditised via “free” on... by state on Wednesday March 16, 2016 @05:09PM (#11300697)
OK, I'll take your word for it.

Everything I do is being tracked, recorded and passed around by companies big and small. Yep, got it.

Anyone care to speculate on how we actually change this situation? Or is it that there's really not much utility in privacy for most people, so we can just forget about it permanently. I realize that the paths to change are either regulatory or technical (and I find the latter more likely), but seriously: paint the picture.

Should we just accept this as the norm?

(edit: grammar)

Re:How your data is collected and commoditised via “free” on... by p4wnc6 on Wednesday March 16, 2016 @07:56PM (#11301627)
It's not a dichotomy between being able to do something about it vs. not getting utility from privacy.

Privacy is extremely important. We get lots of utility from privacy and in fact require it to reach states of adequate mental and physical health.

But people with guns and money can prevent us from having it, despite how much utility it is, despite that it is considered a basic right, and regardless of whether we want to change it.

Re:How your data is collected and commoditised via “free” on... by state on Wednesday March 16, 2016 @08:21PM (#11301761)
That's an interesting way to think about it. It's true that in our daily lives we absolutely depend on privacy and are aware of it being compromised.

Perhaps therein lies the real problem: for the most part these oversteps are barely noticeable. 'Doing something' amounts to a kind of activism. I can accept that as the necessary course of action at this point in time. Working for the right to privacy in the future could be analogous to protecting natural resources.

Re:How your data is collected and commoditised via “free” on... by 9248 on Wednesday March 16, 2016 @07:44PM (#11301570)
Not accept, but adapt and learn to live with it.

I'm saying this because I don't see any solution. Our data can be sold. Our data can be 'shared' by our less educated friends,etc. Our data can be 'leaked' through all kinds of breaches/hacks/etc from both private companies or even governmental(incompetence, old software).

Treat our public records as public, as an interface to the outer word. Why do we think that our names, emails, phone numbers or addresses are private? What's the point of them being private?

Re:How your data is collected and commoditised via “free” on... by choosername on Wednesday March 16, 2016 @07:56PM (#11301624)
Avoiding abuse, that's the point, obviously. There is sensitive data very susceptible to abbuse, because their privacy is crucial to many privacy schemes, but not well protected.
Re:How your data is collected and commoditised via “free” on... by bigiain on Wednesday March 16, 2016 @11:54PM (#11302476)
Pay cash.

Use anonymous prepaid credit/gift cards (bought with cash) online.

Delete your cookies,

Browse in incognito.

Disable Javascript.

Block ads.

Don't install the social media app (and if you do, definitely don't give LinkedIn/Facebook/whoever unfettered access to your contact lists and email accounts!). Use the mobile website (in mobile Chrome, in incognito. Yeah, you'll have to log in more often...)

"Dress up. Leave a false name. Be legendary. The best PT is against the law, but don't get caught. Art as crime; crime as art." - Hakim Bey, "Poetic Terrorism", T.A.Z, 1991

Re:How your data is collected and commoditised via “free” on... by amelius on Thursday March 17, 2016 @05:50AM (#11303430)
Inject noise into your corner of the internet.

Or pay somebody to do it for you.

Re:How your data is collected and commoditised via “free” on... by bduerst on Wednesday March 16, 2016 @07:05PM (#11301374)
This isn't a popular question, but is there really a problem?

I've heard the big-brother nightmare scenario type answers before, but I'm curious to see how they are more likely to negatively affect me than a car accident or slipping in the shower.

Even with government agencies (NSA/FBI) overstepping or trying to overstep their limits, isn't the root problem with policy makers keeping them in line?

Re:How your data is collected and commoditised via “free” on... by AnonymousPlanet on Wednesday March 16, 2016 @07:53PM (#11301615)
I will answer you with a lengthy anecdote. A couple of years ago I wanted to buy something from a popular online shop. The shop offered various payment options. I won't bother with details, so let's make it simple: option A was no risk on their side but time consuming, while B was higher risk but fast procedure. I was time pressed, so I was happy to see B in their FAQ. After signup and checkout there was no option B for payment. I thought it was a bug in their site and sent them an email.

I then decided to have it shipped directly to my parents (I wanted to use the item over the holidays) and set up an account in their name. After checkout, option B was suddenly available. Yay, they fixed it. I made the order.

Back to my account: option B was still missing. Huh.

I then made several new accounts using various addresses over the city. The pattern that emerged was that in more affluent zip codes option B was available, in poorer parts it wasn't.

Several days later, my email was answered: they claimed not to offer B to any new accounts on principle. This clearly wasn't the case.

My sample set wasn't big, and maybe it was a bug or A/B testing plus coincidence, but it made me think.

Big brother will not kill you or bite you with big fanfare. Instead, you will be struck by inconveniences. Online shopping will be more pleasant for some and maybe even impossible for others. That flashy item you want will be available for others but you will be told that it's out of stock. All of this will be explained away as mistakes.

Re:How your data is collected and commoditised via “free” on... by bduerst on Wednesday March 16, 2016 @08:50PM (#11301873)
What? It sounds like the problem is they didn't have enough information about you.

If they had more info, they could avoid blanket policies such as avoiding riskier shipping options with all new customers, and use with customers they can prove are not fraudulent.

But here's my anecdote:

I bought a metal collar extender at Macy's with my credit card. It was an impulse buy at checkout and I have never searched, emailed, liked, etc. this product in my life. I get on Amazon a week later and I have a recommendation carousel of metal collar extenders. I was so surprised I even checked my email for a receipt to see if that's how Amazon retargeted me [there was none].

But then I just stopped caring, because I realized that if anything Amazon was incurring an opportunity cost for not recommending me something more useful, and I have more important things to do with my time than to worry about how I'm being retargeted on Amazon.

Re:How your data is collected and commoditised via “free” on... by AnonymousPlanet on Thursday March 17, 2016 @02:29AM (#11302872)
> What? It sounds like the problem is they didn't have enough information about you.

That is part of my point. It will never be perfect, but perfect enough to get a benefit for businesses. If this leaves you as part of a small percentile at the road side, that is your problem not their's. In the end, you may be regularly unfairly disadvantaged because of it nevertheless.

Re:How your data is collected and commoditised via “free” on... by bduerst on Thursday March 17, 2016 @01:30PM (#11305980)
This is an example of a Nirvana fallacy - where you are saying it should be abolished because the "perfect solution for everything" is unattainable. If anything, your anecdote proves that should be made even better, not abolished.

Besides, the business lost a customer with you, so it's obviously not perfect enough for them either.

Re:How your data is collected and commoditised via “free” on... by Throwaway23412 on Wednesday March 16, 2016 @09:29PM (#11302025)
It is incredibly easy to see where your anecdote could go wrong. What if you had bought something much more personal or embarrassing?

Condoms? Plan B? Dildos? Lube? Imagine having to explain to a family member sitting next to you why those items are showing up in your Amazon recommendations.

I recall an example a few years ago about a store's marketing system telling a father that his teen daughter was pregnant before she ever told him. Because the store's system had correctly inferred from her previous purchases that she was pregnant and started giving recommendations for stuff like diapers.

Suppose a homosexual in the closet was buying sexually explicit things or an atheist in a religiously strict home or country was buying blasphemous materials.

Ironically, your anecdote presents much worse scenarios than the parent comment's anecdote.

Re:How your data is collected and commoditised via “free” on... by bduerst on Wednesday March 16, 2016 @09:35PM (#11302047)
Slipping down the slope of embarrassing adult toys shows a lack of understanding of how these networks work.

Again, this isn't a problem with retargeting. What if I just bought sex toys directly on Amazon and they made product recommendations for it while I was browsing at work? Or what if Facebook and Google showed me adult ads while reading Forbes.com?

That's on Amazon et al for displaying adult sex toy recommendations. Same as your nightmare scenario of where I'm a persecuted homosexual in Saudi Arabia, and Amazon makes homosexual product recommendations to me while the religious police man is looking over my shoulder.

Re:How your data is collected and commoditised via “free” on... by pyre on Wednesday March 16, 2016 @10:59PM (#11302317)
"That's on Amazon" but you're bearing the consequences. What consequences would there be in the nightmare scenario for Amazon? None. They get the power and not the responsibility.
Re:How your data is collected and commoditised via “free” on... by bduerst on Thursday March 17, 2016 @01:03AM (#11302682)
They have your problem now and already address it. It isn't unique to retargeting.

They lose customers. Ad networks lose websites. Walled gardens lose users.

That's why you don't see promoted dildos on Amazon, Forbes, and Facebook even now - and why your nightmare scenario is just a bad daydream about rubber cocks.

Re:How your data is collected and commoditised via “free” on... by WalterBright on Thursday March 17, 2016 @04:39AM (#11303203)
I replaced a leaky kitchen faucet with one I bought online. For weeks afterwards, banner ads for that exact same faucet kept appearing everywhere. Did they think I had two kitchens?

I notice the targeted advertising all the time, and I've never been tempted to buy. Their predictive algorithms on what I'd like to buy next are hopelessly wrong and often (like the faucet) simply incompetent.

Re:How your data is collected and commoditised via “free” on... by AznHisoka on Wednesday March 16, 2016 @09:35PM (#11302045)
Is that same credit card saved in your Amazon account?
Re:How your data is collected and commoditised via “free” on... by DanBC on Wednesday March 16, 2016 @07:58PM (#11301641)
> Big brother will not kill you or bite you with big fanfare. Instead, you will be struck by inconveniences. Online shopping will be more pleasant for some and maybe even impossible for others. That flashy item you want will be available for others but you will be told that it's out of stock. All of this will be explained away as mistakes.

A boring dystopia? https://news.ycombinator.com/item?id=10787650

Re:How your data is collected and commoditised via “free” on... by AnonymousPlanet on Thursday March 17, 2016 @02:37AM (#11302884)
It is not enough for a cyberpunk action movie. The consequences for society are chilling, however. Picture a society in which everyone has even more reason to behave and live in a certain way just so they don't get misjudged by some algorithm.
Re:How your data is collected and commoditised via “free” on... by majewsky on Thursday March 17, 2016 @05:49AM (#11303426)
Hasn't it always been like that? Just replace "some algorithm" with "social norms". I don't see a qualitative difference.

Wait, actually, one difference. The algorithm adjusts much quicker than social norms, which is why it seems to affect you more. Changing of social norms is usually only observed by people who are older than the average HN reader.

Re:How your data is collected and commoditised via “free” on... by majewsky on Thursday March 17, 2016 @05:43AM (#11303406)
I had a similar thing just recently. I was sitting in a hackerspace trying to book a hotel. It wasn't possible there because they wanted a credit card (just as safety if I don't show up, I was going to pay in the hotel anyway).

Since I don't have a credit card, I IM'd a friend if I could use his credit card for the booking. I went over to his place, and when I did the booking process at his home, suddenly I could book without a credit card.

My hypothesis is that the hotel website didn't trust me in the hackerspace since I was connecting to them over a VPN.

Re:How your data is collected and commoditised via “free” on... by njharman on Thursday March 17, 2016 @01:14AM (#11302709)
That has nothing do do with collected data. You gave them address, the matched with census, they offered better option if your address was lower risk.
Re:How your data is collected and commoditised via “free” on... by AnonymousPlanet on Thursday March 17, 2016 @01:55AM (#11302800)
That has everything to do with data collections. It won't always be something obvious as poor zip codes. When data of many people is collected it enables the establishment of certain behavioural types. Then when you come along with the few data points they know of you, the gaps can be filled. What goods you buy, travelling behaviour, waking hours can all be used to characterize you. Regardless of whether this labelling is fair.
[dead]
Re:How your data is collected and commoditised via “free” on... by Spooky23 on Wednesday March 16, 2016 @10:27PM (#11302219)
In the U.S., it is an illegal practice in the context of lending.

It's also leads to really ridiculous situations. For example, living in Brooklyn, NY made it impossible to rent a car in the 90s without an existing relationship with a rental agency. Living in a black neighborhood made it impossible to get a mortgage.

Re:How your data is collected and commoditised via “free” on... by yummyfajitas on Thursday March 17, 2016 @08:32AM (#11303932)
I'm aware that we have a multitude of (often confused and nonsensical) laws, which in some cases force businesses to ignore data and make bad decisions.

My question; what argument can you make in favor of enacting such laws if they didn't exist? And if you make such an argument, does it also imply that small females should ignore the fact that Delhi is the rape capital of India? Or that pizza shops should put their drivers in danger of robbery?

Re:How your data is collected and commoditised via “free” on... by Spooky23 on Thursday March 17, 2016 @11:55AM (#11305146)
It's all a part of the governance process.

In NYC, a decision was made and actions taken to improve the safety and security of the environment so that a woman can safely walk the streets unmolested.

Re:How your data is collected and commoditised via “free” on... by Nadya on Wednesday March 16, 2016 @08:05PM (#11301680)
>I've heard the big-brother nightmare scenario type answers before, but I'm curious to see how they are more likely to negatively affect me than a car accident or slipping in the shower.

You aren't until you are at which point it is too late. "First they came for..." yatta yatta.

Power is often only given in small, seemingly harmless chunks. When someone tries to take too much power - people take notice and prevent it because they know what others often do with too much power.

The problem as I see it is that too few people notice the small chips and blocks of power they willingly give away until they realize they've given away too much and no longer hold the majority of the power. Only then do they see the foolishness in what they have done, but by then it is already too late: they are powerless.

Re:How your data is collected and commoditised via “free” on... by astazangasta on Wednesday March 16, 2016 @07:42PM (#11301561)
We're possibly months away from a Trump presidency, and you're not worried that this sort of power exists in the world? Trump aside, the general trend is increasingly fascist. Maybe you're safely ensconced in the glitterati, but I am a known leftist with brown skin; I'm going to worry.
Re:How your data is collected and commoditised via “free” on... by bduerst on Wednesday March 16, 2016 @08:39PM (#11301837)
Come on, even this nightmare scenario isn't that nightmarish. The POTUS commands the nuclear arsenal, which is arguably more powerful than knowing my shopping habits.
Re:How your data is collected and commoditised via “free” on... by majewsky on Thursday March 17, 2016 @05:50AM (#11303431)
Depends. The POTUS is not likely to use the nuclear arsenal against you. Your personal data, though, is much more actionable from his POV.
Re:How your data is collected and commoditised via “free” on... by bduerst on Thursday March 17, 2016 @01:34PM (#11306019)
Yes, because I was implying Trump would nuke the U.S. /s

You have only to listen to his rhetoric on foreign policy to connect the dots about how giving him power is potentially harmful to the U.S. Unless you think he's going to try to sell everyone steaks and golf course timeshares as the POTUS, then I'm worried.

Re:How your data is collected and commoditised via “free” on... by teaneedz on Wednesday March 16, 2016 @07:19PM (#11301453)
Find an alternative to ad-supported business models maybe. Isn't much of this data used by/for the advertising industry?
Re:How your data is collected and commoditised via “free” on... by gertef on Wednesday March 16, 2016 @07:30PM (#11301505)
You mean, create an alternative to broadcast, mail, and free services, and migrate the entire world off of it?
Re:How your data is collected and commoditised via “free” on... by losteric on Wednesday March 16, 2016 @05:04PM (#11300657)
If it's legal to sell, it's for sale. Credit cards definitely sell your info.

People also forget about "public data". Student organizations (sport tournaments, student bands, chess club, etc) and middle school/high school/college graduation lists are big ones for targeting young consumers. Facebook/Twitter is just the tip of the iceberg. Hyper-targeting is very real and companies know way more about you than you think.

Pay cash and be mindful of what data gets online.

* On a more positive note, I'm excited to see how digital personal assistants integrate this kind of data for personalization.

Re:How your data is collected and commoditised via “free” on... by shostack on Wednesday March 16, 2016 @04:59PM (#11300629)
There's a lot more (Axciom, Neustar, etc.). Just check out one of these Lumascapes--the data companies are slightly off to the right near the top in the DB Marketing, DMP and Marketing Data sections [1].

Advertisers and publishers can also sell this data directly on exchanges (a relatively new thing) like Adobe's Audience Marketplace [2].

[1] http://www.lumapartners.com/lumascapes/marketing-technology-...

[2] https://blogs.adobe.com/digitalmarketing/advertising/source-...

Re:How your data is collected and commoditised via “free” on... by arafa on Wednesday March 16, 2016 @05:59PM (#11301009)
A lot of how personal data is collected and sold is detailed in Bruce Schneier's "Data and Goliath" (http://www.amazon.com/Data-Goliath-Battles-Collect-Control/d...) and confirms what you're saying.
Re:How your data is collected and commoditised via “free” on... by choosername on Wednesday March 16, 2016 @07:58PM (#11301635)
link to amazon

kinda ironic

Re:How your data is collected and commoditised via “free” on... by Gustomaximus on Wednesday March 16, 2016 @11:50PM (#11302466)
I'd wouldn't say the bulk comes from large stores vs. 'win-a-trip' type sites. Its both. I buy these leads on a regular basis (many millions a year) and I'd say where the most comes from depends on country primarily. Also businesses like Dominoes typically dont sell identifiable customer data, they will often present your company as an offer either via EDM, newsletter or ever increasingly post-transaction via lead aggregators.

When Dominoes/Target type organisations do sell data it's typically done in a non-PII (personally identifiable information) format, for legal, ethical and brand reasons. This way companies can utilise the data do things like understand purchase personalities/habits by postcode type thing but they dont directly know who you are. There is another subset of companies that claim they can take this non-PII data and re-match it to people but I'm skeptical about how accurate this is.

Another an area not mentioned of personal darta storage that is every growing is programmatic media. In this ad servers attempt to identify you and call on stored information which is then used in a stock market like real-time environment to bid for ad views. Like when ads follow you around the internet, but for every sophisticated information/algorithmic rationale on who you are. Nothing nefarious but marketers want to show ads that are likely to be interesting and result in a sale (or other company goal).

Re:How your data is collected and commoditised via “free” on... by jsonne on Wednesday March 16, 2016 @11:56PM (#11302482)
This is pretty spot on. It's also good to note that marketers like me don't get your name and everything about you. We get anonymous and aggregated data. Eg. I have no idea if you John Doe personally buy dominos. I'm target 50k people that like dominos, also like cars, and live in the Bay Area.
Re:How your data is collected and commoditised via “free” on... by hodwik on Thursday March 17, 2016 @09:52AM (#11304307)
I'm not talking about marketing systems. I'm talking about systems full of PII -- like Thomson Reuters CLEAR -- which was designed for law enforcement but can be purchased by private companies as well.

http://r1.officer.com/files/base/image/OFCR/2013/04/16x9/640...

Re:How your data is collected and commoditised via “free” on... by hodwik on Thursday March 17, 2016 @09:48AM (#11304282)
I disagree. From what I've seen, Dominoes and Target sell your PII to companies who make systems primarily marketed to law enforcement, but are also available to private companies.
Re:How your data is collected and commoditised via “free” on... by bsilvereagle on Wednesday March 16, 2016 @05:48PM (#11300946)
> everywhere you have ever lived, all of your phone numbers, voting records, debts, legal history, marriages, past names and aliases, email addresses, everything.

A lot of these things are publicly available from government entities. Voter records (available from sites like voterfind.com) include your address, and phone number in some locales. Marriage licenses are public record. If a debt goes to court, it becomes a public record. Any and all legal incidents are public record. Property taxes are public record.

Re:How your data is collected and commoditised via “free” on... by hodwik on Thursday March 17, 2016 @09:55AM (#11304329)
Yes, technically. In the US your SSN, your mother's maiden name, and all of your school records are public data under many circumstances.

That doesn't mean they get used or treated as such.

Re:How your data is collected and commoditised via “free” on... by majewsky on Thursday March 17, 2016 @09:11AM (#11304087)
Depends on the law. Most or all of these examples are not public record in Germany.
Re:How your data is collected and commoditised via “free” on... by webbore on Wednesday March 16, 2016 @07:13PM (#11301417)
I saw a (I believe) 60 minutes story about WalMart a while ago and they stated they stored everything at line-item resolution for 2 years of sales. With their volume it's an amazing amount of data. UPDATE - did some quick googling and that was 10 years ago. I have no idea how big their DW is now (was 583 TB then)
Re:How your data is collected and commoditised via “free” on... by hammock on Wednesday March 16, 2016 @07:52PM (#11301609)
The one thing about Walmart though, and many of the largest retailers like Kroger, is that that market basket data is far too valuable to allow it into the hands of anyone else - and they won't/don't sell it.

Other smaller retailers, including Target and hundreds of others, will pool their transaction data into blind coops like Abacus, or syndicate it via companies like dunnhumby.

Re:How your data is collected and commoditised via “free” on... by stephengillie on Thursday March 17, 2016 @01:49AM (#11302789)
If you play games with Steam, someone is recording your play sessions. It's not actually much different from graphing when your Facebook friends are asleep[1].

Valve, being an NIH shop, use a UDP call instead of an API like most groups[2]. At a minimum, you can get the Steam name of every player on any server.

[1] https://news.ycombinator.com/item?id=11130688

[2] https://developer.valvesoftware.com/wiki/Server_queries

Re:How your data is collected and commoditised via “free” on... by bigiain on Wednesday March 16, 2016 @11:43PM (#11302441)
That's true about "the bulk of the data ( … that is collected and comoditized by "free" websites … )" sense, but Troy's article is talking about a specific breach he'd been given and his investigation of it's providence. _This_ bunch of data had, with a fairly high degree of certainty, come from shady "Take a free trip!" websites. (Admittedly, the headline is misleading there, but that's typical of headlines...)
Re:How your data is collected and commoditised via “free” on... by fweespee_ch on Wednesday March 16, 2016 @05:06PM (#11300676)
> Source: You'll have to take my word for it.

Fwiw, I agree with you. ;)

Source: Someone tried to sell me this sort of thing once as part of an age verification service.

Re:How your data is collected and commoditised via “free” on... by daodedickinson on Wednesday March 16, 2016 @05:51PM (#11300965)
Haha so why not sell this to dudebros worried about getting brought up on statutory rape charges? Or is there already an app for that?
Re:How your data is collected and commoditised via “free” on... by fweespee_ch on Wednesday March 16, 2016 @05:57PM (#11301000)
Because I have something resembling a soul?

Iirc, their marketing said they were ~95% accurate.

Re:How your data is collected and commoditised via “free” on... by daodedickinson on Wednesday March 16, 2016 @07:27PM (#11301490)
Well I think it might be a valid public service to keep people from committing statutory rape. Or are your worried about the effect on your soul when 5% of the time someone has underage sex and another person goes to jail?
Re:How your data is collected and commoditised via “free” on... by fweespee_ch on Wednesday March 16, 2016 @07:48PM (#11301589)
> Well I think it might be a valid public service to keep people from committing statutory rape. Or are your worried about the effect on your soul when 5% of the time someone has underage sex and another person goes to jail?

That is what I'd be worried about. I gave them false assurance and I'd feel responsible.

Re:How your data is collected and commoditised via “free” on... by wiradikusuma on Thursday March 17, 2016 @04:48AM (#11303228)
Honest questions: How do you explain to your potential buyers (or govt agencies) when they ask you where you get the data from? "Various sources"?

I mean, sure, you can collect data however you want, but I don't think any legitimate business want it unless you collected it legitimately. Or am I wrong?