News for hackers. Stuff that matters.
Re:Google Safe Browsing can kill a startup by teamspirit on Saturday January 16, 2021 @04:28PM (#25805675)
Here-here! I really wish there was more human involvement in a lot of these seemingly arbitrary AI-taken actions. Everything from app review to websites and more. This heavy reliance on automated systems has led us down this road. Shoot, keep it, just give us the option to guarantee human review - with of course transparency. We don't need anymore "some human looked at this and agreed, the decisions is final, goodbye."

I know it's easier said than done, especially when taking the scale of the requests into account, but the alternative has, does, and will continue to do serious harm to the many people and businesses caught in this wide, automated net.

Re:Google Safe Browsing can kill a startup by pryce on Saturday January 16, 2021 @04:43PM (#25805776)
It's interesting how closely the unfolding of this awful scenario has followed an entirely predictable path based on the shifting incentives: now hundreds of thousands of businesses face the same massive hazard of blocklisted without adequate human review, and with mediocre options to respond to it if it occurs.

Without a shift in incentives, its unlikely the outlook will improve. Unless the organisations affected (and those vulnerable) can organise and exert enough pressure for google to notice and adjust course, we're probably going to be stuck like this -or worse- for a long time.

Re:Google Safe Browsing can kill a startup by Retric on Saturday January 16, 2021 @07:24PM (#25806866)
Blacklisting a site incorrectly seems like a perfectly adequate reason for a defamation lawsuit. So, I think the real issue is with the legal system.
Re:Google Safe Browsing can kill a startup by craftinator on Saturday January 16, 2021 @06:05PM (#25806368)
> this awful scenario has followed an entirely predictable path

The interesting things about predictable paths is that at the start there are a LOT of them, then over time there becomes just one of them. I don't see that this path was any more predictable at the start than any other.

Re:Google Safe Browsing can kill a startup by judge2020 on Saturday January 16, 2021 @09:23PM (#25807477)
It feels like the need for automated systems is a result of the ever-increasing size of the world (there are now nearly 5 billion internet users[0]). For Apple, app review can take days, mainly because doing human review [consistently] well and constantly for 8 hours a day isn't easy[1], leading to staffing issues when bad reviewers get weeded out and only a small percentage of hires stick around. Outside of hiring 10,000 employees just to endlessly review phishing links for 40 hours a week, you need automation to triage these phishing sites and deal with the outcome later such as via on-demand review by a human (which worked in this case, but won't always work - humans still make mistakes). I'm not sure if there is a solution for this problem outside of just not having the safe browsing product if 'makes no errors' is a requirement.

0: https://en.wikipedia.org/wiki/Global_Internet_usage

1: https://www.businessinsider.com/heres-why-it-really-sucks-to...

Re:Google Safe Browsing can kill a startup by cthor on Sunday January 17, 2021 @12:29AM (#25808428)
There's no reason the number of humans dealing with these problems can't scale alongside the number of humans creating them.

But it's a lot cheaper to pay for a few really expensive programmers to make a just-good-enough AI than to pay for thousands of human moderators. So we end up with a stupid computer creating tonnes of human misery all for the sake of FAANG's already fat profit margins.

Re:Google Safe Browsing can kill a startup by hutzlibu on Sunday January 17, 2021 @06:49AM (#25809995)
"So we end up with a stupid computer creating tonnes of human misery all for the sake of FAANG's already fat profit margins."

I don't want to blame this entirely on the big companies, though. Also the people want and expect "free" things on the internet. This is how we ended up like this.

Re:Google Safe Browsing can kill a startup by unishark on Sunday January 17, 2021 @02:14AM (#25808858)
> There's no reason the number of humans dealing with these problems can't scale alongside the number of humans creating them.

I would think the attackers are using automation also, to spam attacks as in other areas of fraud. It can only be a battle of AI ultimately.

Re:Google Safe Browsing can kill a startup by Perseids on Sunday January 17, 2021 @04:12AM (#25809343)
Depends on which problem your tackling. With App reviews for example it is very easy to rate limit the 100 USD developer licenses. And also in cases like the one the medium article is facing businesses would gladly pay a hundred bucks to get real humans to produce competent answers/reviews/decisions. And if you dislike this solution because it creates a google tax (pay us or we'll block your site), make it not a service payment, but a security deposit which they'll only keep if you are fraudulent in some way.
Re:Google Safe Browsing can kill a startup by jsinai on Sunday January 17, 2021 @06:19AM (#25809849)
Is it just me but the way things are currently stacked, human insight is still the best line of defence? The OP and other anecdotes in the comments are examples why we’re not quite at “AI vs AI” yet
Re:Google Safe Browsing can kill a startup by TimTheTinker on Saturday January 16, 2021 @04:48PM (#25805810)
:s/Here-here/Hear hear/
Re:Google Safe Browsing can kill a startup by kubanczyk on Sunday January 17, 2021 @09:20AM (#25810804)
Hear hear!

Where where!?

Here here!

Re:Google Safe Browsing can kill a startup by alfiedotwtf on Saturday January 16, 2021 @04:40PM (#25805763)
> I really wish there was more human involvement in a lot of these seemingly arbitrary AI-taken actions.

Narrator: but it was only ever to get worse

Re:Google Safe Browsing can kill a startup by RileyJames on Saturday January 16, 2021 @05:16PM (#25806038)
Couldn’t agree more, the transparency is key. It enables faith in the system and outcome.

The counter argument to transparency will be that it provides too much information to those who aim to build phishing sites not blocked by the filter.

That said, we’ve experienced systems in which obfuscation wins out over transparency and it would be nice to tackle the challenges of transparency.