News for hackers. Stuff that matters.
Re:An advanced browser fingerprint calculator aimed mainly a... by gregw134 on Tuesday March 21, 2017 @09:49PM (#13927941)
I worked on designing tracking scripts for six months (Sorry. Fortunately they aren't in production). Fingerprinting was very difficult to pull off in practice: even with canvas fingerprinting, font enumeration, plugin enumeration, etc. most mobile phones are still indistinguishable. Desktops are easier to fingerprint because they often have unique browser plugins or a unique set of fonts installed. Even with desktops, fonts and other settings usually change within a matter of days, so its difficult to identify a user unless they're browsing from the same ip address you've seen them at before.

What used to work really well were Flash cookies. Adobe had a security hole where Flash cookies weren't cleared when you cleared your regular cookies. The only way to clear your Flash cookies was to open the Flash application on your laptop and clear all content, or visit a special webpage Adobe built to help users clear their cookies. So for years marketers could store any cookies they wanted this way. This only ended when Chrome began embedding a version of Flash into the browser so Flash cookies could be deleted when other cookies are deleted.

The other mechanism that was really interesting was ETag tracking. When you request a picture or other asset from a website, the website can send you an etag id which is supposed to signify the picture's version. When the client revisits the page, the client sends back the etag to confirm the version cached is the same as the version on the server. The security leak is that the etag protocol allows arbitrary text to be set as an etag, so to set an etag cookie all you have to do is place a 1x1 pixel on each page with a random GUID, and when the user revisits the page the browser will resend the tracking etag in its request for the 1x1 tracking pixel. This works for browsers with cookies disabled, and will remain when cookies are cleared. The only way to clear it is to clear all browsing history entirely, including cached images. Fortunately, Chrome now clears cached images by default when you clear your cookies.

Re:An advanced browser fingerprint calculator aimed mainly a... by jfindley on Wednesday March 22, 2017 @06:00AM (#13929651)
There are a whole BUNCH of other ways available. In practice, no single thing is even close to 100% accurate, but once you have enough distinct indicators you can fingerprint to a pretty high level of accuracy (for many advertisers 80% accuracy is enough, and it's probably not worth spending lots of effort to go above 90%). Clock skew, for example, is slightly different on each device, but on a given device doesn't change that quickly. Mouse/finger movement patterns, TLS negotiation timings, etc, etc. There are even technologies able to track users across different devices, but it's been too long since I worked in this area to be able to speak confidently about the methods used to implement that.
Re:An advanced browser fingerprint calculator aimed mainly a... by trendia on Tuesday March 21, 2017 @11:49PM (#13928332)
While you were working on it, how did you feel about the ethics of trying to unmask people who are clearly trying to browse privately?
Re:An advanced browser fingerprint calculator aimed mainly a... by gregw134 on Wednesday March 22, 2017 @02:06AM (#13928797)
I thought it was very questionable, but I was in debt and that was the only job I could get at the time. There's actually a positive use for browser fingerprinting in that it could theoretically detect Mitm attacks or stolen cookies. Basically, if you place a unique cookie on each device, and then a user/device shows up with that cookie but a totally different browser fingerprint, it's possible that the account was hacked. The client I was working for was a bank so I was pushing for it to be used in this way. But realistically, I knew it was probably going to be used for marketing or privacy invasion but felt like I needed to keep the job to pay the bills.
Re:An advanced browser fingerprint calculator aimed mainly a... by G3E9 on Wednesday March 22, 2017 @10:30AM (#13931175)
The detecting of hijacked sessions with browser fingerprinting (mouse movements, typing speed, etc.) is a very neat idea - something that could be used to throw off red flags or have users sign-in again with the appropriate warnings and education.
Re:An advanced browser fingerprint calculator aimed mainly a... by trendia on Wednesday March 22, 2017 @02:13AM (#13928820)
I appreciate your honesty, thanks for replying.
Re:An advanced browser fingerprint calculator aimed mainly a... by unscaled on Wednesday March 22, 2017 @06:28PM (#13935611)
Besides stolen sessions, using browser fingerprinting for detecting login attempts with stolen passwords is even more useful.
Re:An advanced browser fingerprint calculator aimed mainly a... by retox on Wednesday March 22, 2017 @01:51AM (#13928743)
I understand where you're coming from. In a past life I trained defence people how to build better software for their killing machines. Sometimes you just have to pay the bills.
Re:An advanced browser fingerprint calculator aimed mainly a... by 3131s on Wednesday March 22, 2017 @04:19AM (#13929265)
That argument is terrible. If you are smart enough to program weapons systems for a defense contractor then you are smart enough to make money doing something else.
Re:An advanced browser fingerprint calculator aimed mainly a... by raverbashing on Wednesday March 22, 2017 @06:01AM (#13929655)
The issue is convincing the other people that someone who does that doesn't need to be an "Angular Ninja" or know by heart the complexity of several sorting algorithms
Re:An advanced browser fingerprint calculator aimed mainly a... by bartread on Wednesday March 22, 2017 @09:09AM (#13930575)
This. I understand that sometimes you might need somebody who can hit the ground running with a particular piece of technology but, most of the time, what you need is a competent engineer, regardless of whether they are currently intimately familiar with your technology du jour.
Re:An advanced browser fingerprint calculator aimed mainly a... by retox on Wednesday March 22, 2017 @10:42AM (#13931303)
I was fresh out of uni, teaching Ada and C++ best practice, along with toolkit and processes. Literally spent my last penny getting to the job interview, then lived on credit and supermarket end-of-day markdowns for six months.
Re:An advanced browser fingerprint calculator aimed mainly a... by elastic_church on Wednesday March 22, 2017 @06:57AM (#13929913)
Only because it has no bounds, like most schools of ethics, but it is responsible financially in this society and Op doesnt work there anymore
Re:An advanced browser fingerprint calculator aimed mainly a... by kozak on Wednesday March 22, 2017 @08:09AM (#13930232)
I live in a country which is fighting off an external aggression for the last several years, and here "making killing machines" for defence contractors is a noble thing because you are literally saving lives with your work. And it's close to volunteering because you won't get paid proper money on such a job (because the money paid to you would likely be donated by other citizens anyway).
Re:An advanced browser fingerprint calculator aimed mainly a... by emanreus on Wednesday March 22, 2017 @11:57AM (#13931943)
I see where you're coming from but that war looks unwinnable to me for either side. You have reached a stalemate so further killing kinda seems pointless in light of that. I've seen civil war first hand and how it can be all too easy to rationalize the killing of "them". I'm not passing any judgment just saying. Anyway, we digress too far.
Re:An advanced browser fingerprint calculator aimed mainly a... by kozak on Wednesday March 22, 2017 @12:15PM (#13932115)
For us, winning means stopping their advance. This is not a civil war, there is a clear external force to counteract. What you call "stalemate" is actually a big achievement for us.
Re:An advanced browser fingerprint calculator aimed mainly a... by BearGoesChirp on Wednesday March 22, 2017 @09:01AM (#13930524)
How far does this logic apply? If it covers building machines used to kill without justification (I'm assuming you wouldn't point this out if you thought the machines killed justified targets), does it apply to someone running a website teaching people how to use malware? Someone using malware? Someone running a website dealing in harmful material that is mostly illegal? Does it matter if we say the person lives in a place where the local authority allows for this activity?
Re:An advanced browser fingerprint calculator aimed mainly a... by eatbitseveryday on Wednesday March 22, 2017 @12:15AM (#13928419)
Understanding how unmasking works by a benevolent party means we provide competition for the malevolent parties, for the benefit of those wanting to browse privately.
Re:An advanced browser fingerprint calculator aimed mainly a... by driverdan on Wednesday March 22, 2017 @10:55AM (#13931412)
I'm not OP but I worked on something similar that also never made it to production.

In our case we were going to use fingerprinting to prevent sweepstakes fraud. People would enter multiple times despite the rules specifying you can only enter once. A lot of people were not sophisticated so much of it was easy to detect (eg same contact info but different email). Some were less easy to detect so I figured fingerprinting could help.

I never finished it so it was never tested in a live environment. We wouldn't have shared the info with anyone except in the case of fraud so I don't see it being a problem.

Re:An advanced browser fingerprint calculator aimed mainly a... by cookiecaper on Wednesday March 22, 2017 @02:20AM (#13928846)
Hello, I feel like taking some downvotes today.

In the same way that a vendor can't force you to honor their intention for you to view, read, and seriously consider the ads sent alongside their content, you can't force them to honor your intention to maintain privacy when you're visiting their servers. If it's fair game for you to mangle their content inside the browser before it gets presented to you, it's fair game for them to ask your browser to send back some bits so they can derive benefit they want. It's your responsibility to select a browser/extension combo that is providing the level of privacy and anonymity that you desire.

There's a bit of an escalatory reciprocal at work here; users demand more and more for free, and companies are left with fewer and fewer ways to get consumers to consciously pay for their goods and services.

I have never worked in adtech or user tracking, but I understand the mindset of those who do, and I don't feel that it's at all inherently evil, as some people make it out to be.

Part of the reason that sophisticated spam operations like private link rings and social media astroturfing are a required part of today's web marketing toolbox is because users are doing everything they possibly can to avoid seeing advertisements alongside their content. All this accomplishes is that ads migrate from explicitly-labeled boxes on the side of the page to the content sections, as "sponsored stories" on news sites, astroturfed comments on blogs, and stuffed product reviews on ecommerce sites.

I don't think there's anything necessarily wrong with end-users running an ad blocker extension if that's what they want to do, and by no means am I suggesting any restriction on their freedom to do it. I run such an extension myself (though I usually wait until I come across a particularly egregious site to install it).

But by the same token, I don't think there's anything wrong with a company attempting to extract what data they can from a user's interaction with them, as long as it's voluntarily given by the user or the user's browser. There is no reason that they shouldn't be free to attempt to fingerprint individual users who are visiting their site, especially since in most cases, the goal is to enhance user experience by providing ads they might actually find relevant instead of asinine.

Just my two cents. I know it doesn't fit everyone's favorite narrative of "business trying to make money are evil", but I think this group of frequently-maligned developers deserve someone to stand up for them once in a while.

Re:An advanced browser fingerprint calculator aimed mainly a... by ComodoHacker on Wednesday March 22, 2017 @05:13AM (#13929481)
I might agree with you about showing ads, but regarding tracking and collecting data there's substantial difference. By collecting and storing users' data, you put people at real risk, even if you collect with consent. The risk is data being stolen or sold and then used for malicious purposes.

For example, if you're a delivery service and you store delivery history, you put your customers at risk of being burgled.

So the ethical attitude would be to avoid collecting and storing anything you can avoid.

Re:An advanced browser fingerprint calculator aimed mainly a... by cookiecaper on Wednesday March 22, 2017 @12:20PM (#13932170)
>I might agree with you about showing ads, but regarding tracking and collecting data there's substantial difference. By collecting and storing users' data, you put people at real risk, even if you collect with consent. The risk is data being stolen or sold and then used for malicious purposes.

I don't think that this type of fingerprinting is necessarily any more insidious/risky than any other ordinary activity one can undertake online. That's not to say that data is not valuable to someone with malice, but I don't think it's so especially dangerous that it's inherently inappropriate to collect it. Ultimately, it's the user's responsibility to find a browser that has strong identity protection features and use them properly if it's a major concern for them.

Things like storing a Flash cookie obviously contradict a user's intention, but I don't see that as automatically unethical just because the user would prefer if it didn't happen. At least not any more unethical than contradicting the publisher's intention of displaying ads.

Re:An advanced browser fingerprint calculator aimed mainly a... by hueving on Wednesday March 22, 2017 @05:07AM (#13929445)
You are completely conflating two orthogonal topics: not wanting to view ads vs. wanting privacy.

User A doesn't mind seeing ads, but user A doesn't want to be tracked by corporations that sell personal information so she clears cookies on each browser exit.

User B hates ads because reason (malware, performance, distracting, etc), so he uses an ad blocker. He doesn't care about fingerprinting across sessions so he doesn't bother clearing cookies.

Do you see how you are are throwing user A under the bus because you have a problem with user B?

There is no excuse for trying to correlate users trying to maintain privacy as a response to an entirely different group of users using ublock.

Re:An advanced browser fingerprint calculator aimed mainly a... by cookiecaper on Wednesday March 22, 2017 @12:31PM (#13932286)
I don't have a problem with either of your hypothetical users. I simply believe that it's the user's responsibility to ensure that their browser is not disclosing more information than they want.

Servers are not committing any ethical violation by attempting to track unique user identities through non-disruptive utilization of normal browser features like cookies, plugins, and ETags.

The unifying thing is that companies want to display ads, but users don't respect that want and employ technological solutions to block ads. That's all well and good.

But by the same token, when a user wants to browse anonymously, there is no reason that servers shouldn't utilize the resources that are regularly available in a typical client-server exchange to attempt to identify the user.

The only contrary argument is that companies should be forced to respect the user's wishes, just because the user wishes for it. That's not how the world works. If the user is concerned that their browser may be leaking information, they should take responsibility and ensure it isn't. It's not on the company's head to ensure that the user's wish for privacy is respected any more than it's on the user's head to ensure that the company's wish to display ads is respected.

Re:An advanced browser fingerprint calculator aimed mainly a... by hueving on Wednesday March 22, 2017 @07:13PM (#13935958)
This logic is all based on not having any ethical concerns about doing something the user didn't intend to participate in. If you don't care about ethics, then you could just extend your argument to say that exploiting vulnerabilities in the user's browser to install tracking code directly into the binary is acceptable as well.

Are you okay with that logical conclusion?

>The only contrary argument is that companies should be forced to respect the user's wishes, just because the user wishes for it. That's not how the world works.

It actually is how much of the world works. What ends up happening is people with no regard for ethics keep abusing this until regulations get passed to force people to stop doing things they know people don't want.

Re:An advanced browser fingerprint calculator aimed mainly a... by cookiecaper on Thursday March 23, 2017 @04:51PM (#13944139)
>you could just extend your argument to say that exploiting vulnerabilities in the user's browser to install tracking code directly into the binary is acceptable as well. Are you okay with that logical conclusion?

No. That's not the logical conclusion; it's the extremist conclusion.

The difference is that with things like cookies and ETags, the browser is designed to return that information back to the server.

The server is not engaging in any malicious injection of foreign binaries or hijacking of program behavior. It's not doing anything to break outside of its allowed permission sandbox. It's using intentional, supported functionality in a non-disruptive manner. The only thing is that some people don't like that some of that functionality allows them to ascertain a user's identity after the user has cleared his/her cookies (ignoring here that the much larger privacy concern is the nearly-constant IP address of the user's home internet connection).

If that's the complaint, and in this case, it is, then there is no fault from the server. The user should ensure that his/her browser is making those privacy controls available. Ignoring the problem and shaming companies for making the connection misplaces blame and allows the problem to remain, exploited only by those whose intent may actually be malicious.

Obviously, there are many malware vendors who use their software to track users. I'm not defending them, nor am I defending those who exploit security bugs to get at data that they're not supposed to be able to access. That's not the case now; all of the fingerprinting methods discussed up to this point are fairly simple and do not involve coaxing software into any bad or illegal behavior, nor do they involve executing any spyware on the client machine.

>It actually is how much of the world works. What ends up happening is people with no regard for ethics keep abusing this until regulations get passed to force people to stop doing things they know people don't want.

No, it's not as simple as something "people don't want". Ethics are not about wants and conveniences, they're about behaving in a fair and honorable way. That's not the same as, and in fact it's sometimes the opposite of, what a customer may demand. Companies have obligations to non-customers as well.

Today, customers are demanding that web publishers make all of their content available at no cost and with no ads. If we take the attitude that "if you don't want users to strip out your ads with client-side software, don't publish it online", it's just as fair to say "if you don't want companies to correlate your visits with server-side software, don't leak information that allows them to do so".

If there's beef to be had with anyone here, it's the browser manufacturers who can't seem to figure out a way to engage in a normal conversation with a peer without leaking data that can be used to uniquely identify the user on the server-side.

Re:An advanced browser fingerprint calculator aimed mainly a... by hueving on Thursday March 23, 2017 @10:44PM (#13946197)
>Ethics are not about wants and conveniences, they're about behaving in a fair and honorable way.

It's not ethical to correlate a user's sessions using etags when they have cleared cookies and caches (or set DNT header). You are expressly behaving against the user's wishes, and there really is no difference in exploiting the browser in other ways to reveal other personal information.

>Today, customers are demanding that web publishers make all of their content available at no cost and with no ads.

Did you even read my original comment? Privacy sensitive people and people that don't like ads are not the same set of people. Stop using ad blockers as a justification for unethical privacy violations.

Re:An advanced browser fingerprint calculator aimed mainly a... by cookiecaper on Friday March 24, 2017 @05:27PM (#13952369)
>It's not ethical to correlate a user's sessions using etags when they have cleared cookies and caches (or set DNT header). You are expressly behaving against the user's wishes, and there really is no difference in exploiting the browser in other ways to reveal other personal information.

You don't see a difference between analyzing the data a browser gives back during normal operation and exploiting security bugs to force browsers to give up information that is supposed to be private? They're tracking your session based on the data that your browser normally sends. They're not crossing any boundaries or stealing any secrets.

The difference between using ETags and exploiting a bug to get secret information is that ETags were never meant to be secret or private. No one thinks they're "personal information". They're normal information that happens to be useful for uniquely identifying a user, as are Flash cookies.

The customer can ask politely not to be identified, but there is no reason that companies have to automatically consider that an ethical obligation just because customers wish it was that way. Customers also wish everything was free.

If you feel browsers should support completely untraceable sessions, that's a feature request. It's not an ethical violation on the part of others that they're not imagining this feature already exists.

>Did you even read my original comment? Privacy sensitive people and people that don't like ads are not the same set of people. Stop using ad blockers as a justification for unethical privacy violations.

We're not talking about specific people, we're talking about general principles. If ad blockers are not unethical in principle, then neither is server-side session tracking, because both stay 100% within the technical bounds without coercing any information from or disrupting the ordinary operation of the other party.

It seems that your conception of ethics really does boil down to "the customer wants it", so it's going to be hard to continue this conversation.

Re:An advanced browser fingerprint calculator aimed mainly a... by dorgo on Wednesday March 22, 2017 @04:15AM (#13929246)
I came across a project that combines all possible ways to store cookies (can't find it now). If user deleted one type of cookie it was recovered from other types. The same information was encoded into 10 to 15 types of cookies (like flash cookie, image cache, etags, browser storage ..). I managed to defeat this supercookie - but it was not easy.
Re:An advanced browser fingerprint calculator aimed mainly a... by kbenson on Wednesday March 22, 2017 @04:19AM (#13929266)
That sounds like evercookie[1] , which has been around for a while.

1: http://samy.pl/evercookie/

Re:An advanced browser fingerprint calculator aimed mainly a... by gregw134 on Wednesday March 22, 2017 @04:24AM (#13929288)
I took a look at that project too. In modern chrome at least, clearing your browsing history and cookies and cache clears all those cookies.
Re:An advanced browser fingerprint calculator aimed mainly a... by smilliken on Wednesday March 22, 2017 @01:52AM (#13928747)
> What used to work really well were Flash cookies.

I heard from an adtech company that a patent troll was granted a patent on this (incredible, using an Adobe feature as designed wins a patent), and would wait until adtech companies reached a sufficient size before suing. They had a well known reputation of settling for a few million and weren't contested.