News for hackers. Stuff that matters.
Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:02PM (#17014335)
I love it how they have “automated systems that remove spam” that somehow remove innocent accounts like this one but completely fail to remove blatantly obvious spam.

I don’t expect the system to be bulletproof and remove advanced spam rings, but when obvious spam is allowed to stay on the platform I’m wondering what the idiots at Twitter are really doing.

Re:Twitter suspended our Open Data project's account and wip... by komali2 on Monday May 07, 2018 @01:40PM (#17014715)
Hold on, I've reported multiple extraordinarily obvious spam rings before, with accounts as old as 2013, and I've even kicked up a stink here when Twitter employees show up, and I was told "bots don't violate the TOS."

I just checked, it's still there https://mobile.twitter.com/ksfAKBARI check followers/following for a massive ring of obvious spam.

Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:59PM (#17014874)
Could everyone who has a Twitter account report some of those? Just to see if a pile of reports from mostly influential accounts (we’re on HN after all) would have any effect.

Here’s a screenshot of the account just in case this actually works: https://i.imgur.com/xNviClq.png

Re:Twitter suspended our Open Data project's account and wip... by dawnerd on Monday May 07, 2018 @03:56PM (#17015955)
It took a lot of effort to get twitter to do something about the crypto spam accounts targeting elon musk. SO obvious yet none of their systems seemed to catch it.
Re:Twitter suspended our Open Data project's account and wip... by komali2 on Monday May 07, 2018 @06:15PM (#17016921)
They're doing something about it? I saw some yesterday.
Re:Twitter suspended our Open Data project's account and wip... by dawnerd on Monday May 07, 2018 @06:31PM (#17017009)
They've definitely been a lot less common. Two months ago the first few dozen comments were all botnets saying they received the money.
Re:Twitter suspended our Open Data project's account and wip... by joncrane on Monday May 07, 2018 @02:51PM (#17015336)
I read a few of the tweets and it's all gibberish. What is the purpose of such a bot? Is the purpose being accomplished?
Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @03:34PM (#17015748)
To inflate some other account's (either spam bot, or someone who buys fake followers) followers and make them look legitimate.

However this particular account is a spam bot as it occasionally tweets financial frauds such as "yes loans any good (link: yes-loans-any-good.txtloanltd.com) yes-loans-any-good.txtloanltd.com #no fax online loans".

Re:Twitter suspended our Open Data project's account and wip... by ropeadopepope on Monday May 07, 2018 @01:14PM (#17014479)
> I’m wondering what the idiots at Twitter are really doing.

What if they're not idiots? What if that system is working exactly as intended?

Re:Twitter suspended our Open Data project's account and wip... by danudey on Monday May 07, 2018 @01:50PM (#17014790)
This is a good point. Maybe Twitter finds that these changes are driving away people who don't monetize as much and appealing to the people who do. Much like Fox News found that scummy "buy gold now!" / "sell your gold now!" ads worked well for their audience, maybe this is what engages people.

I mean, it works for spam. Obvious bad english, poor spelling and punctuation, etc. weed out people who know this is an obvious scam, leaving only the type of people who will overlook every red flag imaginable because their gullibility and greed overwhelms them.

Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:17PM (#17014507)
Whoever designed how this system is supposed to work (as in, allow the spam to remain) is still an idiot in my view. Granted, I’m sure they have an agenda to justify this (aka boost user numbers as much as possible, even if all of them are bots) but as a user I don’t care - I see spam on the platform and I call them out for it.
Re:Twitter suspended our Open Data project's account and wip... by ropeadopepope on Monday May 07, 2018 @01:27PM (#17014597)
> Whoever designed how this system is supposed to work (as in, allow the spam to remain) is still an idiot in my view

Why? If you don't know what the goal is, how can you judge the results? Just because you don't care for the result doesn't make the person who designed the system an idiot. It makes you an idiot for continuing to use a system you hate.

Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:31PM (#17014637)
I never said I used the system. I deleted my account in 2013 when they started making the platform worse and worse with every “upgrade”.

I loved Twitter and I wish they get their stuff together and make it enjoyable again, but I’m not expecting anything anymore. They’re most likely going to go down the same way Yahoo did.

Re:Twitter suspended our Open Data project's account and wip... by ropeadopepope on Monday May 07, 2018 @01:37PM (#17014694)
> They’re most likely going to go down the same way Yahoo did.

Unlikely. Yahoo actually had to make a profit. In 12 years, Twitter has only reported 1 profitable quarter. And yet, somebody (or somebodies) keep forking over billions of dollars to keep twitter up and running. Whatever their goal is, making money isn't it.

My guess is their goal is the same as the major media outlets: to control the flow of information. It's a lot easier to do that without scrutiny if the tools appear to kick people off at random. The harder it is to discern a pattern, the less scrutiny they'll face when taking down accounts that say things they don't like. It also provides cover if there's a big stink and they have to reinstate an account.

Re:Twitter suspended our Open Data project's account and wip... by narrator on Monday May 07, 2018 @01:33PM (#17014649)
AI bugs are the new plausible deniability. You think this is a mess now? Wait till we get robotic AI weapons everywhere.
Re:Twitter suspended our Open Data project's account and wip... by nothis on Monday May 07, 2018 @01:33PM (#17014652)
The curves of false-acceptance vs false-rejection rates usually overlap, even in their optimum. I do not envy a billion-user-level website like Twitter having to deal with this. Automation is probably still better than trying to do this manually and failing even more? Who knows, though.
Re:Twitter suspended our Open Data project's account and wip... by jimnotgym on Monday May 07, 2018 @01:41PM (#17014726)
Is spam a problem for Twitter users?

It is bots and the algorithmic timeline (which Twitter spam with lots of people i don't follow) that ruined it for me. The bot issue seems simpler to solve than spam, (a Turing test?) and I can only think that Twitter feel the bots will one day make them profitable.

Re:Twitter suspended our Open Data project's account and wip... by pound on Monday May 07, 2018 @01:09PM (#17014409)
re: "idiots at Twitter" - It's always nice to encounter someone smart on internet.
Re:Twitter suspended our Open Data project's account and wip... by FRex on Monday May 07, 2018 @01:17PM (#17014511)
I once wanted to have a Twitter account without a phone number attached to it.

It got banned within 5 minutes of being created, I didn't use Tor, proxy or anything shady, a normal Chrome browser and a normal gmail account. All I did was Tweet once (their own localized hell world tweet where I didn't even fill in the text).

Reason was something that amounted to breaking their ToS via 'automated use' or some shit. Of course if I were to provide my mobile number it'd get instantly unlocked, 0 human oversight on that too.

Opening a support ticket sent me their automated crap email saying the same thing and asking for phone number again to instantly get my 10 minutes old account unlocked.

I never heard from a human.

They reap what they sow.

Edit: and by 'without a phone number' I mean I didn't fill it in when creating the account (I don't even remember if it asked there but I somehow got an account open without one), just out of principle of not wanting to give any more information than I need to any service I use. And of course I didn't divulge it after that borderline ransomware situation and my opinion of Twitter has dropped (generously speaking..). It was also my only ever attempt at having a Twitter account, not a secondary account or something like that. I also have a static Polish IP for years now, no other service ever 'caught' me for being a bot, it was in an up to date Chrome on Windows 10, etc.

Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:10PM (#17014431)
I assume this is sarcasm, so I’d like to point out that I don’t consider myself smarter than anyone else or anything - I say idiots simply because there’s no excuse where blatantly obvious spam (for example the crypto currency scam replies in response to famous accounts like Elon Musk) isn’t deleted automatically.
Re:Twitter suspended our Open Data project's account and wip... by pound on Monday May 07, 2018 @01:14PM (#17014478)
If you know how to reliably solve that easy problem I'm pretty sure they're hiring
Re:Twitter suspended our Open Data project's account and wip... by ksenzee on Monday May 07, 2018 @01:25PM (#17014572)
Solving that particular problem is not hard: trash any reply to a celebrity or viral tweet that includes a link and gets reported x times. There was a good Twitter thread on this recently, pointing out that we look for complicated solutions when simple ones would do. https://threadreaderapp.com/thread/987602838594445312.html
Re:Twitter suspended our Open Data project's account and wip... by JoshTriplett on Monday May 07, 2018 @01:42PM (#17014730)
> Solving that particular problem is not hard: trash any reply to a celebrity or viral tweet that includes a link and gets reported x times.

That's trivial to abuse, given a group of accounts filing false reports.

That's not a hypothetical; as an example, Facebook's reporting functionality has been abused to attack people's accounts as part of various hate campaigns.

Re:Twitter suspended our Open Data project's account and wip... by empath75 on Monday May 07, 2018 @01:36PM (#17014683)
If you’re relying on reports that can be gamed.
Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:45PM (#17014753)
> Automated systems can and will be gamed as well.

Taking an user’s reputation, account lifetime, reputation of their followers, etc (so for example, a report from a new account has less weight than an established account with a good history) will sort that out.

And when everything else fails, a proper appeals system where you talk to humans will solve this problem once and for all. False positives and abuse are bound to happen eventually, but they’re tolerable as long as you have a proper appeals process to deal with them.

Re:Twitter suspended our Open Data project's account and wip... by A2017U1 on Monday May 07, 2018 @01:26PM (#17014588)
Automatically flag any account making a reply with the same name or same picture. It's incredibly simple yet they don't do it.
Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:26PM (#17014585)
I’m sure their engineers (if they still have any - I haven’t seen any innovation from Twitter in a long time) are more than capable of fixing this if management lets them.

Hiring more engineers isn’t going to solve it. Management and product is where the real problem is IMO.

Re:Twitter suspended our Open Data project's account and wip... by fortythirteen on Monday May 07, 2018 @01:11PM (#17014439)
To be fair, if the only thing they're geniuses as is making a money pit look attractive to investors.
Re:Twitter suspended our Open Data project's account and wip... by yosito on Monday May 07, 2018 @01:20PM (#17014540)
> I’m wondering what the idiots at Twitter are really doing.

Focusing on profit.

Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:22PM (#17014550)
Profit? Which profit?

Not to mention, having spam on the platform isn’t really a good strategy for profit anyway.

Re:Twitter suspended our Open Data project's account and wip... by fortythirteen on Monday May 07, 2018 @01:09PM (#17014418)
It all makes sense when you realize that they're lying and their "automated system" is a bunch of low level contractors.
Re:Twitter suspended our Open Data project's account and wip... by gaius on Monday May 07, 2018 @01:15PM (#17014488)
Artificial artificial intelligence, if you will
Re:Twitter suspended our Open Data project's account and wip... by ManFromUranus on Monday May 07, 2018 @01:14PM (#17014477)
<Charlton Heston Voice> "Automated system" is made of people!
Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:12PM (#17014460)
Most likely, but then I wonder, what do their 1k-5k (according to CrunchBase) employees really do? A simple spam flagging system (that’ll take care of the lowest hanging fruit aka very obvious spam) can be built even by a single engineer.
Re:Twitter suspended our Open Data project's account and wip... by modsec on Monday May 07, 2018 @01:18PM (#17014518)
I see comments like this coming up on Hacker News almost every month and I tend to think that people who make these comments are either too young and/or have not worked for a mid-sized to a large company.

If you have worked in any company that deals with internet-facing traffic serving the size of audience that Twitter does, it should be obvious that 1k employees is nothing if you want to have all the necessary teams you need to keep the business running, for example, software engineering, software support, hardware engineering, hardware support, network engineering, software engineering, HR, finance, legal, PR, management, IT department, etc.

A company of this scale is not just code and raw technical skills. There are many nuances that you need to appreciate before you understand why it involves 1k-5k employees.

Re:Twitter suspended our Open Data project's account and wip... by paulgb on Monday May 07, 2018 @01:29PM (#17014610)
I've worked for a number of internet companies (including half of FANG), and to be honest, if they wanted to clean up a lot of this stuff by having one or two data scientists tackling low-hanging fruit it would go a long way.

Typically it doesn't happen because it's more profitable to use data scientists to sell more ads.

Re:Twitter suspended our Open Data project's account and wip... by jnbiche on Monday May 07, 2018 @01:40PM (#17014717)
Before being acquired by Facebook, WhatsApp was supporting 900 million users with only 50 employees. So it can be done if you know what you're doing, run a robust tech stack, and don't worry about customer service (and to be clear, Twitter doesn't do customer service, either).
Re:Twitter suspended our Open Data project's account and wip... by foo101 on Monday May 07, 2018 @02:01PM (#17014889)
So why do you think they had to grow from 50 employees to beyond 1k employees?
Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @02:42PM (#17015259)
Because Facebook? Because they switched from providing a great service to try and milk out as much money as possible from their users by the way of ads and privacy violations?
Re:Twitter suspended our Open Data project's account and wip... by FRex on Monday May 07, 2018 @01:40PM (#17014718)
Just last month Krebs got told by Facebook report system carding is welcome content on Facebook: https://krebsonsecurity.com/2018/04/is-facebooks-anti-abuse-...

I've reported someone leaking Polish court documents of an ongoing case on Facebook - nothing happened.

I've reported a YouTube video praising Anders Breivik as an European hero defending whites from Marxists, Leftists and Muslims - it's still up.

I've created a Twitter account and it got instantly locked for being 'suspicious' or 'automated' (but of course giving them my phone number would fix it instantly) - https://news.ycombinator.com/item?id=17014511

What are the nuances that I'm missing?

Re:Twitter suspended our Open Data project's account and wip... by ampersandy on Monday May 07, 2018 @05:04PM (#17016481)
Your attitude on this entire thread has been incredibly condescending. Why don't you try and think of why these problems are hard instead of just assuming they are all easy, as you've done so far?

I challenge you try and think through why your simple spam filter and human appeals process will not scale to Twitter's size. What kind of throughput can it handle? What happens when there is more content being appealed than the review team can handle? How do you prevent attackers from maliciously flagging other users' content? How do you handle advanced threats where attackers compromise existing accounts then begin to spam, thus bypassing any "easy" checks like looking at account age? How do you classify "hateful" speech? How does it scale to foreign languages, slang, etc?

Re:Twitter suspended our Open Data project's account and wip... by eli on Monday May 07, 2018 @01:15PM (#17014483)
How would that be different from the existing spam flagging system?
Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:18PM (#17014522)
Well the existing system doesn’t seem to be working right. Blatantly obvious spam is allowed to remain, just see the spam replies to any big account’s tweets or spam on certain popular hashtags.
Re:Twitter suspended our Open Data project's account and wip... by eli on Monday May 07, 2018 @01:30PM (#17014621)
Or the existing system works as designed but your suggestion of a "simple spam flagging system that could be written by one engineer" is not a sufficient solution. (And keep in mind that any anti-spam tools will be definitely abused be trolls and other malicious actors to harass innocent users)
Re:Twitter suspended our Open Data project's account and wip... by modsec on Monday May 07, 2018 @01:11PM (#17014454)
> idiots at Twitter

A constructive comment would have been to point us at good spam filters that are very good at not allowing obvious spam so that we do not make the same mistake that Twitter did and be labelled as "idiots" by the likes of you on the Internet.

Re:Twitter suspended our Open Data project's account and wip... by Rjevski on Monday May 07, 2018 @01:14PM (#17014482)
Any of the open-source email spam filters? Not saying they’re excellent by any means but they’d at least take care of the most obvious spam there is. False positives can be dealt with appeals - allow people to actually appeal the decision and get a human to review it. I’d take the occasional false positive with a proper appeals system any day over the current cesspool that is Twitter.
Re:Twitter suspended our Open Data project's account and wip... by modsec on Monday May 07, 2018 @01:23PM (#17014553)
Like what? SpamAssassin? You would be surprised how much obvious spam gets through it in the face of the kind of spam onslaught that goes on in the real world today.

Seriously, this problem is not as easy to solve for machines as you think it is.

Re:Twitter suspended our Open Data project's account and wip... by kaoD on Tuesday May 08, 2018 @01:26AM (#17019007)
Well, they're Twitter. How does Google filter all my Gmail spam? So far I've had one or two emails go through in all these years and my account is available in several leaks, receiving tens of spam mails a day.

And email seems like a harder place to police, being decentralized. These guys control the gateway to the service!

Re:Twitter suspended our Open Data project's account and wip... by crankylinuxuser on Monday May 07, 2018 @01:16PM (#17014500)
Or, you can spend human time to review a decision like "Delete account with known good history", rather than the current SV trend of 'automate it, fuck it, who cares? We'll wait until someone complains on HN or Reddit'

The first rule is you don't delete user data without consent. The second rule, is you dont delete user data without consent!

And yes, I work in the industry. Bad shit happens, and data can be lost. But trusting some automated 'spam detection algo' and making actionable, irrecoverable decisions on fuzzy math is completely idiotic, boneheaded, and fucking stupid! If you're in that product team, you deserve every shred of scorn you're getting.

Re:Twitter suspended our Open Data project's account and wip... by kbenson on Monday May 07, 2018 @01:34PM (#17014661)
> the current SV trend of 'automate it, fuck it, who cares?

I think some of the reason this comes about is that it's deprioritized until it's a major problem, and you're already at a large scale, and then the decision is "require human review, even of what appears to be a fraction of the deletions, and get swamped with thousands or tends of thousands of reviews immediately", or "just delete them".

That's not an excuse for the decision, since obviously they could have taken care to address this problem at least minimally much earlier, and there wouldn't be a deluge of work, but I think we all understand whey they weren't keen to do that (even if it's a crap decision for their users).