News for hackers. Stuff that matters.
Re:Hacking of artificial intelligence is an emerging securit... by solarkraft on Saturday January 19, 2019 @08:32AM (#18946953)
What another shitty title. "Turning data against itself". It doesn't make me want to click the link at all. I did though and, while blinded by the terrible layout, it seems like they're showing off some of the techniques used to mess with AI systems.
Re:Hacking of artificial intelligence is an emerging securit... by renholder on Saturday January 19, 2019 @09:00AM (#18947072)
>The hacking of artificial intelligence is an emerging security crisis.

They stress that it could happen but that it hasn't really been found to be purvasive in the wild but also call it a "security crisis". Sensationalisation much?

Re:Hacking of artificial intelligence is an emerging securit... by Just_Smith on Saturday January 19, 2019 @09:43AM (#18947260)
Sensationalism is definitely the right word for this. The article talked more about "white-noise attacks" on NNs than anything else, but I've yet to hear of a white-noise attack that did anything worse than make a NN misidentify an object. Sure, in the right system, that could possibly wreak havoc, but right now, it's not much more than a parlor trick. Maybe if an attacker knew enough about their targeted model, they could have a little more control over the outcome, but that would require some white-box insight to the model. But just because it's possible to feed corrupted pictures into a NN until it breaks isn't enough to call this an "emerging security crisis".
Re:Hacking of artificial intelligence is an emerging securit... by doublekill on Saturday January 19, 2019 @11:11AM (#18947669)
You do not need white box access to a target model anymore. You can find adversarial samples for an ensemble of similar networks and it will fool the target network.

The parlor trick becomes dangerous to the powers that that be, when you start fooling surveillance and smart gun turrets or drones. This is already happening in the background. That is where the funding comes from, not a SV company fearing that their face filter does not work, but governments afraid their deep net border security will be rendered moot.

If anything the article is countering hype by citing researchers saying we don't really know how deep learning learns and represent objects, and that deep nets are a very weak copy of the human brain.

Re:Hacking of artificial intelligence is an emerging securit... by mr_toad on Saturday January 19, 2019 @05:18PM (#18949543)
It’s much easier to modify a 2D static photo than it is to modify the real world.

If you want to make a self driving car think there’s an Ostrich in the road, the easiest way would be to put an Ostrich in the road.

Re:Hacking of artificial intelligence is an emerging securit... by blackflame7000 on Saturday January 19, 2019 @08:48AM (#18947013)
I guess the idea is that by feeding bad data they can do the equivalent of implanting bad thoughts in someone. Think of it this way, if your parents raised you racist you would probably think racist thoughts until you learned enough perspective
Re:Hacking of artificial intelligence is an emerging securit... by tcbawo on Saturday January 19, 2019 @09:45AM (#18947271)
Noticing differences in people is natural and starts at an early age. I observed this in my own children. However, what we identify as racism and sexism is learned behavior. It emanates from stereotyping, prejudice, and bias.
Re:Hacking of artificial intelligence is an emerging securit... by zozbot123 on Saturday January 19, 2019 @09:55AM (#18947321)
Stereotyping, prejudice and bias are natural behavior and are observed even in children. Whether the specifics of racism, at most, are learned or not is somewhat immaterial-- as for sexism, there's even less ambiguity about it being deeply rooted in human nature somehow in a way that's very hard to change - it certainly isn't our "societal structures" telling kids that females have cooties.
Re:Hacking of artificial intelligence is an emerging securit... by _underfl0w_ on Saturday January 19, 2019 @09:51AM (#18947305)
I believe that's exactly what the parent was implying.
[dead]
Re:Hacking of artificial intelligence is an emerging securit... by whitexn--g28h on Saturday January 19, 2019 @09:47AM (#18947278)
Using our "natural trains of thought" most people believed the earth was flat. Most beliefs about racial inequalities have similar merit.
Re:Hacking of artificial intelligence is an emerging securit... by alex_anglin on Saturday January 19, 2019 @09:40AM (#18947246)
Where exactly is the science that says all races and sexes are not equal? Sure there are different traits, but those don't speak to equality.
Re:Hacking of artificial intelligence is an emerging securit... by nzi on Saturday January 19, 2019 @09:47AM (#18947280)
If there are different traits they can't be equal.

Whether they should be equal in rights, for example, that's a different matter. But races and sexes are different, mentally and physically.

Re:Hacking of artificial intelligence is an emerging securit... by ben_w on Saturday January 19, 2019 @10:05AM (#18947367)
Which is smarter, someone with a degree in physics or someone with a degree in biology?

Right now, the concepts we have of “intelligence” are not sufficiently rigorous to for a meaningful discussion on interracial differences — how much of “common sense” is culture, for example? How true is the Sapir-Whorf hypothesis? Test scores for Asian woman can be noticeably modified if you tell the participants it’s “to test if Asians are better than westerners at maths” versus “to test if men are better than women at maths”, how much effect does that observation have on any historical results?

That’s not to say “there are no genetic influences on intelligence” — there must be, otherwise bacteria would be as smart as humans — but rather that large scale groups of humans are so close that we don’t have sufficient evidence to support treating them as different.

Re:Hacking of artificial intelligence is an emerging securit... by Just_Smith on Saturday January 19, 2019 @10:00AM (#18947347)
Difference and equality are not mutually exclusive concepts, because "equality" is based on what you're measuring. A chicken sandwich and a burger are "different" but "equal" in value. Two markets in the company I work for may be geographically and demographically "different", but they could be "equal" in their revenue.

The only way two people who are "different" would not be equal would be if you're measuring specific traits alone, and not the holistic value of the person. Which, for me, raises the question of what traits you think are "better" than others.

Do I even want to know?

Re:Hacking of artificial intelligence is an emerging securit... by ortheopposite on Saturday January 19, 2019 @08:55AM (#18947047)
Curious example, for me personally it was the opposite