News for hackers. Stuff that matters.
Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @01:23PM (#3296091)
What percentage of all the SMS messages send by Sprint Android phones in a day do you think 10 gigabytes is? Start here: the US generates about 2 trillion SMS messages in a year across all phones.

There are multiple YC startups that could write the (bad) marketing sentence "we receive raw data (known as metrics) from X and convert them into reliable, repeatable Measures which feed into analytic applications". Personally, I'm inclined to think that when someone writes "we receive raw metrics", they mean "they receive raw metrics". You seem to premise your entire comment on the idea that "raw metrics" means "tremendous opportunities for abuse, damage to national security, corporate espionage".

Those two points --- 10 gigabytes, and "raw metrics" --- seem literally to be the entire basis of your (currently top ranked) comment.

I wish I could be more strident in disagreeing with you (because your tone makes me want to be), but I have to admit that I have no clue what this company is taking off Sprint phones. I'm inclined to believe that nobody could be dumb enough to take the contents of SMS messages from phones --- Sprint doesn't want that data --- but who knows?

I wrote a similarly negative comment yesterday when this story hit HN the first time. Then I read downthread and found John Graham-Cumming thoughtfully picking apart the story. I read his comment, re-read mine, and deleted mine. 'jgc's comments on this story are interesting; ours are less so; his is buried under yours now. Perhaps you could follow my lead.

Re:Secret app on millions of phones logs key taps by DevX101 on Wednesday November 30, 2011 @01:59PM (#3296304)
Myself and almost every other mobile phone user have the reasonable expectation that third parties should not have the ABILITY to read or modify my private and personal information unless I explicitly give you permission to do so.

This fundamental principle is embedded in all the software I use. I consider any software that doesn't adhere to this principle malware. When my PC crashes, Microsoft asks me if I want to share information with them about what led to the crash. I usually say no, but I appreciate them asking. When I use gmail, I do so with the understanding that Google has full access to the contents of my email. They promise me that they won't do any funny stuff and I accept the conditions of this contract in exchange for free email.

I never entered into such an agreement with CarrierIQ. I've never even heard of CarrierIQ until this week. Yet despite this, they are logging everything I type into my phone, and sending some portion of the information that they log.

If I offered you $100 to install a program I wrote that logged every keystroke on your computer and sent some portion of this information to my own server over TCP, without giving you a privacy policy, you know very well you'd never take me up on this offer. So why is it ok with CarrierIQ?

The focus on how much information is in 10GB is beside the point. The point is that CarrierIQ has been demonstrated to have the ability to read and send everything you type into your phone. At this point we're just hoping they're the good guys and won't do anything overtly evil. But what's to stop them from calling the following function on your phone?

if username == 'tptack': sendStoredData()

Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @02:29PM (#3296471)
All this comment does is moralize. It adds no new information and provides no useful analysis. The only analysis you've provided to date appears flawed; for instance, it asserts that "10 gigabytes a day" of "raw metrics" implies "message contents".

As 'potatolicious seems fond of saying, "that's not even wrong".

Everyone agrees with you already.

I always forget, is it light or heat that's the one you don't want? You're adding more of the bad one, and none of the good one.

Apart from rebutting your analysis earlier, I'm under no illusion that my comment is helping clear up this ${INSERT_NERD_FREAKOUT_HERE} either, but I'm at least happy to speak up and raise the meta point that we shouldn't be rewarding comments like yours. Also, for obvious reasons, I'm past giving a shit about comment karma, so I can just say what I think.

Re:Secret app on millions of phones logs key taps by DevX101 on Wednesday November 30, 2011 @02:55PM (#3296587)
A ${NERD_FREAKOUT} is what led to the enormous backlash against SOPA which very well may play an instrumental part in defeating the bill.

Principles matter, meta discussions like these matter. The technology we work on don't operate in a social vacuum.

Re:Secret app on millions of phones logs key taps by miles on Wednesday November 30, 2011 @03:14PM (#3296694)
@DevX101 - don't let the grumpy guy get you down. Your comments are spot on.
Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @03:05PM (#3296632)
No amount of principle excuses lazy, broken analysis.
Re:Secret app on millions of phones logs key taps by CamperBob on Wednesday November 30, 2011 @11:58PM (#3298428)
Do you have a dog in this particular fight?
Re:Secret app on millions of phones logs key taps by tptacek on Thursday December 01, 2011 @12:41AM (#3298543)
Yes. HN is becoming stupider by the day, and I like HN.
Re:Secret app on millions of phones logs key taps by someone13 on Thursday December 01, 2011 @01:54AM (#3298702)
Well, in the interest of keeping the signal/noise ratio high, here's my view on things.

When someone uses a mobile phone, they generally have the assumption that, unless they consent to it, third parties do not have access to their data (the government being a different story I won't go into). When I use GMail, I consent to Google reading my email via automated algorithms, and targeting ads at me through that. If I have anything important, I use email that I host myself or, if it's really top-secret, an anonymous throwaway account through Tor.

However, from what this video demonstrates, CarrierIQ is violating the basic principle of this by capturing and potentially logging your personal data without your knowledge or consent. Furthermore, it's violating the assumption that most people have that their passwords and such are not captured by applications other than the ones that they are entered into.

Now, we don't know for sure whether all this information is sent off to their servers and logged or not. However, in my personal opinion, the fact that this information is CAPTURED AT ALL is a serious problem, when combined with the fact that you are not informed of this!

Re:Secret app on millions of phones logs key taps by bfrs on Thursday December 01, 2011 @12:54AM (#3298567)
Are you a Carrier IQ shill or something?
Re:Secret app on millions of phones logs key taps by Natsu on Thursday December 01, 2011 @02:42AM (#3298777)
He can't be.

He's one of the people who has been on HN forever. He's often a bit contrarian, but I don't doubt that he believes what he says, even when I strongly disagree with it. And if you scroll up, you'll see that I've already made clear my disagreements on this one.

Re:Secret app on millions of phones logs key taps by onemoreact on Wednesday November 30, 2011 @01:43PM (#3296197)
There software is not on all phones so the total number of SMS messages is irrelevant. Assuming the average text message are 80 charters and they can be compressed 75% then 10GB could be 500 million messages a day and 180billion / year which would be 10% of the total messages in a year. Or with enough meta data 10GB could represent a tiny fraction of that. So, IMO the real question is what information they actually collect not how much data they are storing.
Re:Secret app on millions of phones logs key taps by marcf on Wednesday November 30, 2011 @01:32PM (#3296138)
At 160 bytes per text and 2T texts per year, there are 800 gigabytes of texts per day. Thus Carrier IQ is monitoring the equivalent of 1% of all texts across all phones. That is still quite significant.
Re:Secret app on millions of phones logs key taps by chc on Wednesday November 30, 2011 @02:39PM (#3296520)
160 bytes per text seems like a very generous estimate. Casual observation would suggest the average is less than half that. I just got a text that seemed pretty long to me, so I went back and measured it. It was 90 bytes (104 characters * 7 bits per character / 8 bits per byte).
Re:Secret app on millions of phones logs key taps by artursapek on Wednesday November 30, 2011 @01:59PM (#3296303)
You're thinking quantitative when you should be thinking qualitative. The worrisome thing is that, as the screenshots show, they seem have access to location-based information.

http://www.carrieriq.com/overview/IQInsightServiceAnalyzer/i...

I wouldn't care if they were logging non-identifying info, such as the amount of time my phone display is on to analyze battery performance, for instance, or perhaps even the general settings I have on my phone to help HTC deliver more desirable "factory settings." Any of this could add up to that 1% you mention.

Speaking personally though I use a 5 or 6-year-old Blackberry model with no data plan and will happily continue to do so.

Re:Secret app on millions of phones logs key taps by samstave on Wednesday November 30, 2011 @01:48PM (#3296229)
But they are monitoring on the client side, correct?

Who is to say the carriers are not processing on the upstream? We certainly know that Carnivore was designed to do just this.

Let's just say; there is NO privacy on ANY digital communications. Period.

If you think otherwise, it is likely just being naive.

We know that the US and China have been in an extended cyber war fro more that 10 years now.

Re:Secret app on millions of phones logs key taps by artursapek on Wednesday November 30, 2011 @02:04PM (#3296332)
To say that is to give up trying
Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @01:44PM (#3296205)
The point isn't how many texts they're getting --- one would be too many. The point is "10 gigabytes per day of metrics" doesn't itself imply that they're getting message contents.
Re:Secret app on millions of phones logs key taps by Steko on Wednesday November 30, 2011 @03:41PM (#3296811)
"The point isn't how many texts they're getting ... "

You, earlier:

"What percentage of all the SMS messages ... do you think 10 gigabytes is?"

Stop moving the goalposts and maybe we'll get somewhere.

Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @03:46PM (#3296835)
You are militantly missing my point. There is no evidence that they are seeing message contents. All we are going on in this thread is the supposition that because they're getting "10 gigabytes a day", it must be message contents.
Re:Secret app on millions of phones logs key taps by rhizome on Wednesday November 30, 2011 @06:23PM (#3297376)
They themselves use the phrase "raw data" to describe what they collect (as "metrics"). Metrics are not comprised of raw data, but of measurements, so unless they're being hinky with word choice, a plain reading of their own materials would suggest that they do indeed receive user content.
Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @07:39PM (#3297629)
They've said repeatedly that they do not collect that data. This is a common attitude on HN threads: the idea that the only facts for us to discuss are the ones in the article itself or in other comments on the thread. There are more facts just a Google search away for you.

Their own words are not dispositive; I'm not suggesting that they are. But here you're trying to interpret their words in a way that contradicts their own direct statement. Your interpretation is possibly accurate, but implausible.

Re:Secret app on millions of phones logs key taps by rhizome on Thursday December 01, 2011 @07:10PM (#3302076)
Re:Secret app on millions of phones logs key taps by tptacek on Thursday December 01, 2011 @07:24PM (#3302109)
I read this and don't see how it clears anything up.

My best guess (I know just as little about CarrierIQ as everyone else on this thread) is that CarrierIQ is trying to collect very innocuous information (performance statistics and event information to correlate them to), but is doing a slapdash job of generating that information --- for instance, by logging raw details to the Android filesystem.

I wouldn't want it on my phone either, but that doesn't make them Big Brother --- or, obviously, a "rootkit".

Re:Secret app on millions of phones logs key taps by rhizome on Friday December 02, 2011 @05:01PM (#3305882)
that the companies are all playing hot potato still, days later, tells me there's more to come out about this.
Re:Secret app on millions of phones logs key taps by rhizome on Thursday December 01, 2011 @04:59PM (#3301567)
Fair enough. Given what you've read, where do you think the line is between "user content" and the data they received?
Re:Secret app on millions of phones logs key taps by Natsu on Wednesday November 30, 2011 @03:14PM (#3296693)
I sincerely doubt that CarrierIQ, or the phone carriers, even care about our text messages. That said, there are other people who do

http://www.schneier.com/blog/archives/2009/11/leaked_911_tex...

Even so, I wouldn't put it past them to do keyword mining for mobile ads. That just seems like such an obvious potential use.

Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @03:20PM (#3296724)
If Sprint wanted to do that, it doesn't need agent software to get the messages.
Re:Secret app on millions of phones logs key taps by scott_s on Wednesday November 30, 2011 @03:59PM (#3296884)
This is an important point that I think some people are forgetting. I use Verizon. They already have access to all of my text messages. I send my text messages to Verizon, who then forwards them on to the person I'm talking to. Just as Google first gets my email.
Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @07:41PM (#3297639)
It is unfortunately a point that the contradicts the thread narrative that casts a hapless, poorly-marketed analytics company as Big Brother incarnate, so nobody's going to pay attention to it.
Re:Secret app on millions of phones logs key taps by Natsu on Thursday December 01, 2011 @02:33AM (#3298764)
They put backdoors on basically every phone in secret, threatened the guy who outed them with a lawsuit and are perfectly capable of snooping on everything, whether they do so or not.

What do you know about them that makes you trust them?

Re:Secret app on millions of phones logs key taps by tptacek on Thursday December 01, 2011 @11:46AM (#3300324)
Nothing. There's just a likely innocent explanation for all three of those things:

1. CarrierIQ is a "secret" in the same sense as the network management software that Sprint uses that can also see all your SMS messages is a "secret": (a) nobody at Sprint thinks its relevant to you, and (b) nobody at Sprint thinks its any of your business. Which, if you take a breath, strictly speaking about the performance metrics they're collecting, it isn't your business.

2. CarrierIQ was dumb about threatening this guy like lots of other companies have been identically dumb. Companies have threatened to sue me. I remain cordial with the owners of some of those companies. Welcome to security research; we don't have jackets, but we sure get a lot of press.

Incidentally, put yourself in CarrierIQ's position and assume that this particular researcher is full of shit, meaning, no, CarrierIQ is not snooping on people's keystrokes. What would you do? There's a guy out there claiming that their performance agent is a "rootkit". They got pissed. Surprised?

3. Any piece of systems software the carrier agrees to stick on the phone is capable of snooping. Sprint itself could just backdoor their Android distro.

Re:Secret app on millions of phones logs key taps by Natsu on Thursday December 01, 2011 @04:18PM (#3301419)
In their shoes, I would have contacted the researcher and explained myself. While unsurprising, that move was unwise, and I would imagine that you agree on that point at least.

I think someone once said that sufficiently advanced incompetence is indistinguishable from malice. Whether they're dumb or malicious, I'm just glad their crap isn't on my phone.

Re:Secret app on millions of phones logs key taps by tptacek on Thursday December 01, 2011 @04:56PM (#3301556)
Even they seem to agree with it; rather than just shutting up about their C&D, they actually issued a formal apology to Trevor. That's an uncommon move.

I don't know whether some other shoe is about to drop; for instance, someone could actually show that they're transmitting real keycodes and not just metrics data. But in the absence of that shoe dropping, especially given how many people have jumped to a conclusion about CarrierIQ, I'm inclined to believe that what they do is actually benign. If you want to get upset at someone, get upset at the carriers themselves. When you do, remember, they're already recording all your messages without CarrierIQ.

Re:Secret app on millions of phones logs key taps by Natsu on Thursday December 01, 2011 @05:05PM (#3301593)
Ok, now see, I missed that part about the apology somehow; I only knew that they dropped the lawsuit when lawyers stepped in. While there's no way I'd allow this crap on my phone, it does get them a little credit.
Re:Secret app on millions of phones logs key taps by vedant on Wednesday November 30, 2011 @01:36PM (#3296162)
Nobody had computed the percentage:

Using 2e12 SMS messages/year, 160 characters/message, and 1 byte/character:

(2e12 * 160) / (365 * (2^30)) = 816.501983 GiB/day

So 10GiB/day is about 1.2% of daily SMS traffic.

EDIT: Too slow.

Re:Secret app on millions of phones logs key taps by DanBC on Wednesday November 30, 2011 @02:12PM (#3296368)
How do you feel about the supposed MITM "feature" of CarrierIQ's product?
Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @02:37PM (#3296508)
I think that the facts matter.

I think that there are zero people on HN that think CarrierIQ is a good idea.

So if all we're doing here is condemning CarrierIQ, let's just replace this whole thread with "CARRIERIQ BAD", followed by a bulleted list of bad things, vote it up to 1000, and then get back to talking about building things.

Re:Secret app on millions of phones logs key taps by gergles on Wednesday November 30, 2011 @03:51PM (#3296858)
Or how about if you don't think that this thread is contributing anything to what you think HN should be, you stop yelling at everyone posting in it and go back to "building things"?

We get it, you don't like this thread. You don't need to respond to every comment with a pedantic "fuck you, shut up, and get off my lawn, I have a billion comment karma because people upvote snark so now I'm going to act like a dick " comment of your own.

Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @07:50PM (#3297675)
No. Tried that. Now trying the other way. These threads are dragging HN down, and I've decided to be noisier about it.

My feeling is that the same name recognition influence that gets most of my comments modded up 100-200% more than they're actually worth is going to get my -4 comments read even though they're light grey. We'll see!

Re:Secret app on millions of phones logs key taps by DanBC on Wednesday November 30, 2011 @04:26PM (#3296973)
> So if all we're doing here is condemning CarrierIQ

I asked someone who is quite good with crypto a question about a possible MITM attack on 141 million phones. I didn't condemn CarrierIQ, I avoided dramatic language, I even added qualifiers to avoid stating something as fact if it wasn't yet confirmed.

Re:Secret app on millions of phones logs key taps by tptacek on Wednesday November 30, 2011 @04:53PM (#3297064)
Sorry. You're right. I let the ultra dumbness of this whole thread bring me down a bit.

Doing an SSL MITM from agent software installed by the carrier on a phone seems pretty silly, since the carrier is in a position to see anything you're typing into your phone anyways (in the sense that it controls the OS).

I'm not sure I buy any analysis that suggests CarrierIQ is really "MITM'ing" SSL --- though that's trivial for a software agent to do --- because the same people saying that are also saying that it's obvious that CarrierIQ is capturing and remote-logging message contents.

Re:Secret app on millions of phones logs key taps by seigenblues on Thursday December 01, 2011 @10:11AM (#3299968)
real question here: Should it be obvious that the carrier controls the OS? Second question: is that acceptable? I mean, that assumption underpins your dismissal of an MITM as "pretty silly", which also seems totally correct.

I'm just curious if that's the way phones will be forever: with the OS controlled by the carrier and with no right to tinker/hack/modify the device you buy & pay huge monthly fees to use.

Re:Secret app on millions of phones logs key taps by tptacek on Thursday December 01, 2011 @01:32PM (#3300839)
I very much wish it wasn't the case that carriers had influence over phone OS's.