News for hackers. Stuff that matters.
Re:Twitter spam wave by lawl on Thursday April 03, 2014 @06:58PM (#7527656)
Luckily my timeline was not affected.

However, I wonder, shouldn't Twitter be able to pick these messages up automatically fairly fast, after (I assume) hundreds if not thousands of users have flagged them?

Also, the spammers can't have unlimited IP's. Twitters anti spam kinda seems to lag back behind E-Mail (subjectively).

Is there a reason the same techniques used in E-Mail aren't applicable to Twitter?

Re:Twitter spam wave by mkjones on Thursday April 03, 2014 @09:21PM (#7528486)
So I can't speak for twitter, but I work on anti-spam at Facebook, and imagine the problems we face are relatively similar. It's worth noting that there's a constant barrage of people trying to send varying degrees of spam. It's not like there's An Attack all of a Sudden - just occasionally people close to the HN social network happen to be targeted by something and it's magnified by the media / hive mind local to us.

> shouldn't Twitter be able to pick these messages up automatically fairly fast

Theoretically, sure. As a human looking at an attack, it's usually pretty easy to pick out "obvious" attributes that they should have been able to catch. But when you're operating at a scale like us or Twitter, even stuff that looks like it's obviously-indicative-of-badness often has false-positives (posts flagged as spam that are not). The long tail of weird stuff that a billion users do can be pretty crazy.

At the same time, the "obvious" attributes of an attack are often very cheap for an attacker to change. Instead, we try to go after more expensive resources (domains, source IPs, etc).

> after (I assume) hundreds if not thousands of users have flagged them

Sadly, looking at flags of content is not a silver bullet. The signal is very sparse (a given spam post is rarely flagged), and nonspam posts are frequently flagged (religious and political speech are great examples - and they are the worst kind of false positive if you delete them as spam). These problems can be somewhat mitigated if you aggregate flags over a dimension that's expensive for the attacker (domain-posted, IP that posted the content, text shingles), but even then the recall isn't necessarily great and you could still catch e.g. controversial political domains.

> the spammers can't have unlimited IPs

True, though you can rent space on a botnet that has many, geographically-diverse, real-user IPs. Also, I imagine a significant chunk of posts to Twitter come from apps, many of which each use a single IP to post tons of content.

> Is there a reason the same techniques used in E-Mail aren't applicable to Twitter?

There's definitely some overlap. I'm not an expert at email anti-spam, but in general it's a relatively different problem. "Traditional" email spam is sent from some random email address on / via a compromised machine or open relay, and seems to be a relatively-well-solved. But it sounds like this twitter attack was caused by compromised accounts. At least anecdotally, it seems that email vendors are also not great at detecting this kind of attack. For example, my gmail account (with arguably the best spam protection in the industry?) gets a message every few weeks from some compromised friend's account. (i.e. someone had their email password stolen and the attacker is using it to "legitimately" send mail after authenticating to that email service with the correct password).

Re:Twitter spam wave by NKCSS on Friday April 04, 2014 @07:43AM (#7530617)
Lol, best quote in a while: "The long tail of weird stuff that a billion users do can be pretty crazy."
Re:Twitter spam wave by lugg on Friday April 04, 2014 @01:58AM (#7529573)
Could you not identify higher than normal viral scores and run some automatic checks on the links content to look for dodgy behavior (ie executing like / share links?) That would still end up with you being in a cat and mouse game of obscuring dodgyness but its a start.

Have you guys looked into sharing likelihoods of affected users? In other words I rarely share stuff I click on. If a higher than normal number of high view - low sharers like myself are sharing its either extremely popular or its spam. (Worth flagging for a manual check)

Re:Twitter spam wave by mkjones on Friday April 04, 2014 @01:40PM (#7533006)
Yep, "URLs shared primarily by not-sharey people" sounds similar to a lot of classifiers we have.
Re:Twitter spam wave by lugg on Friday April 04, 2014 @11:05PM (#7535805)
Your job sounds pretty fun I must say.
Re:Twitter spam wave by rossjudson on Friday April 04, 2014 @07:14AM (#7530517)
I don't know if you hear this often enough, but thank you for fighting this fight. And I hope you're well paid for doing it.
Re:Twitter spam wave by taternuts on Friday April 04, 2014 @03:57PM (#7533930)
I think it's safe to say that he/she probably is, at facebook.
Re:Twitter spam wave by davidgerard on Friday April 04, 2014 @08:38AM (#7530912)
Yes, I admin a FB group with sockpuppeting spammers daily, and it took me a while to understand why the "report account" facility didn't offer a "spam" option.
Re:Twitter spam wave by Houshalter on Thursday April 03, 2014 @10:49PM (#7528876)
Perhaps you can weight the flags of users. Like users who have flagged non-spam content in the past don't count, and people who have flagged lots of spam count more.
Re:Twitter spam wave by mkjones on Thursday April 03, 2014 @10:53PM (#7528895)
Yeah, we've played with that idea a bit. It doesn't help the sparseness problem (actually makes it worse), and if we took action as a direct result, it would give people the power to DoS content they disagree with.

For sites operating at a smaller scale, this could be a good way to surface content for manual review though.

Re:Twitter spam wave by peterwwillis on Friday April 04, 2014 @10:36AM (#7531625)
Could you hire people just to review/flag stuff on a part-time basis, ala Mechanical Turk? Or is the problem just not big enough to warrant the time/money investment?

I imagine that while spam is annoying, it probably doesn't impact your bottom line in a big way.

Re:Twitter spam wave by RA_Fisher on Friday April 04, 2014 @12:56AM (#7529393)
Are you using elastic net or other things to handle sparsity? Lots of Bayesian priors?
Re:Twitter spam wave by devindotcom on Thursday April 03, 2014 @07:32PM (#7527891)
I don't know. Part of the normal use case of Twitter is people mindlessly retweeting something or posting the exact same thing as everyone else. That's just trending stuff. With something thousands and thousands of people are sharing, it would take quite a few flagging it to raise any red flags.
Re:Twitter spam wave by pseut on Thursday April 03, 2014 @09:35PM (#7528539)
Yeah, I was just thinking that. About 90% of what I see on twitter I would consider spam if it were sent by email. :)
Re:Twitter spam wave by chimeracoder on Thursday April 03, 2014 @07:09PM (#7527719)
> Is there a reason the same techniques used in E-Mail aren't applicable to Twitter?

Twitter relies on very low latency - ie, once you tweet something, if it a whole minute to appear in your friends' timelines, it could already have lost much of its value.

Lots of spam reduction techniques introduce latency to levels that are unacceptable to Twitter's use case.

I'm not sure why it didn't catch these, but I can imagine why the same techniques aren't applicable in general.

Re:Twitter spam wave by thrownaway2424 on Thursday April 03, 2014 @07:51PM (#7528035)
I doubt if that's even true, because Twitter's tail latency on API calls is in the hundreds of seconds. They do not operate a low-latency service (and they don't operate a high volume service either, by my standards).

I think the real problem is not latency, but simply they don't have the signals needed to differentiate spam from not.

Re:Twitter spam wave by comex on Thursday April 03, 2014 @11:27PM (#7529036)
Speaking as a user, when someone sends me a reply, I expect to see it in seconds via the streaming API so I can have a short IM-style conversation, and I consider this a nice benefit to using Twitter (rather than, say, email), if not totally essential. Hundreds of seconds sounds bad, but if that were the norm, it would be a serious problem.
Re:Twitter spam wave by scg on Thursday April 03, 2014 @08:28PM (#7528249)
Where did you get the latency data from?
Re:Twitter spam wave by orf on Thursday April 03, 2014 @07:14PM (#7527747)
Sure, but couldn't they run something that cleans up already posted tweets? That wouldn't introduce any latency while posting but would still (eventually) get rid of them automatically and hopefully pretty fast.
Re:Twitter spam wave by elwell on Thursday April 03, 2014 @07:25PM (#7527845)
I think they are. Most of the search results I'm seeing are only up until a minute ago.
Re:Twitter spam wave by CWuestefeld on Friday April 04, 2014 @10:51AM (#7531717)
If my twitter account was compromised and used to send spam, I think the way I'd discover this is by seeing the record of tweets sent by the false "me". If those are being culled, then how will I know that my account has been compromised?
Re:Twitter spam wave by mntmn on Thursday April 03, 2014 @07:33PM (#7527903)
They do – they deleted a tweet from my timeline.
Re:Twitter spam wave by fastest963 on Thursday April 03, 2014 @07:29PM (#7527870)
You can do pretty aggressive spam detection in way less than 100ms.

Source: I wrote a system that can do it in less than 10ms at Grooveshark.

Re:Twitter spam wave by rubyrescue on Thursday April 03, 2014 @07:35PM (#7527915)
any way i could pick your brain for 20 mins? we're dealing with a lot of it at whisper... would buy beers or ... whatever you want.
Re:Twitter spam wave by mkjones on Thursday April 03, 2014 @08:15PM (#7528190)
hey I work on anti-spam at FB. Happy to talk sometime. facebook.com/mkjones or @fisherrider on twitter (lol).

You can learn a little about how we think about securing login here: http://vimeo.com/80460475.

Re:Twitter spam wave by rubyrescue on Thursday April 03, 2014 @08:35PM (#7528290)
thx, will reach out!
Re:Twitter spam wave by fastest963 on Tuesday April 08, 2014 @02:10AM (#7551672)
Shoot me an email [email protected]. Love to chat!
Re:Twitter spam wave by stevekemp on Friday April 04, 2014 @04:57AM (#7530107)
I've never timed it, but I do try to do realtime-spam detection on blog/forum comments:

http://blogspam.net/

Although it operates at a much smaller scale than most of the things linked to here it does work pretty well.

Re:Twitter spam wave by fvryan on Thursday April 03, 2014 @07:28PM (#7527861)
Here's a graphical look: http://blog.datarank.com/recent-twitter-spam-behavior-quanti...

Appears to have started on March 31st and has affected > 100K Tweets. It also appears to run between the hours of 2PM and 10PM PST, peaking at 7PM each day.