News for hackers. Stuff that matters.
Re:AI is going to supercharge surveillance by etiam on Monday January 29, 2018 @07:23AM (#16257051)
About time this gets more mainstream coverage. The risks with this use are both far more imminent and potentially more severe than "AI" developing godhood or putting everyone out of their jobs by doing it for them.

A few years back there was this reportage: http://www.newyorker.com/magazine/2015/11/23/doomsday-invent... It mostly focused on Nick Bostrom's concerns about "Superintelligence", but to me the more interesting passage by far is this one:

The keynote speaker at the Royal Society was another Google employee: Geoffrey Hinton, who for decades has been a central figure in developing deep learning. As the conference wound down, I spotted him chatting with Bostrom in the middle of a scrum of researchers. Hinton was saying that he did not expect A.I. to be achieved for decades. “No sooner than 2070,” he said. “I am in the camp that is hopeless.”

“In that you think it will not be a cause for good?” Bostrom asked.

“I think political systems will use it to terrorize people,” Hinton said. Already, he believed, agencies like the N.S.A. were attempting to abuse similar technology.

“Then why are you doing the research?” Bostrom asked.

“I could give you the usual arguments,” Hinton said. “But the truth is that the prospect of discovery is too sweet.” He smiled awkwardly, the word hanging in the air—an echo of Oppenheimer, who famously said of the bomb, “When you see something that is technically sweet, you go ahead and do it, and you argue about what to do about it only after you have had your technical success.”

As the scientists retreated to tables set up for refreshments, I asked Hinton if he believed an A.I. could be controlled. “That is like asking if a child can control his parents,” he said. “It can happen with a baby and a mother—there is biological hardwiring—but there is not a good track record of less intelligent things controlling things of greater intelligence.” He looked as if he might elaborate. Then a scientist called out, “Let’s all get drinks!”

Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @08:47AM (#16257432)
I think every technology is a tool in the first place and allmost everything can be abused.

And about nuclear bombs, well you can argue that they prevented World War 3. Also I think Orion-Project. (nuclear bombs as a way to accelerate a rocket in deep space)

And KI I believe likewise.

It is just a problem of power balance. If you americans don't trust your agencies, then you have the power to control them. But as far as I know, most common people have rather a dubious NSA who fights terrorists for them, than none or a weak NSA and terrorists everywhere.

Here in Germany it's the same. So I would not focus on the technology and rather on the people behind it, if you can trust them. And if not - find new people/add transparency. To some extent this is happening in germany after some secret service apparently let nazi terrorist murder non-germans (or were extremely incompetent in failing to notice) and hindered police investigation.

So now something is happening, but only because people are upset. But yes, with recent terror attacks, most still tend to view them as a necessary evil.

edit: and yes, terrorists are a problem and to fight them efficient, police/secret service maybe can't play by the normal rules all the time.

But on the other hand, most terrorists justify their actions, because they view themselves as attacked and exploited first. To which there is some truth. So it is a complex world. But I don't think it is doomed because of KI ...

Re:AI is going to supercharge surveillance by jcbrand on Monday January 29, 2018 @10:28AM (#16257993)
> most common people have rather a dubious NSA who fights terrorists for them, than none or a weak NSA and terrorists everywhere.

What a ridiculous false dichotomy.

Juxtaposing "terrorists everywhere' with whatever it is you're trying to sell is sophistry at it's best/worst.

This black and white, this or that, kind of thinking is so tiresome sometimes.

Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @10:41AM (#16258078)
Erm, maybe I made that not clear enough, but I was arguing from the point of view of the common people.

Not my point of view.

My point of view is now spread out all over this thread. That it is indeed complex.

But of course, I also agree that there is also truth to that statement, the stronger your (ethical) terrorists fighting agency, the less terrorism.

But yes, if you fight terrorism by bombing villages somewhere else, maybe you have a bad long term strategy.

Re:AI is going to supercharge surveillance by jacquesm on Monday January 29, 2018 @09:05AM (#16257510)
> And about nuclear bombs, well you can argue that they prevented World War 3.

Absent a control you can't even argue that.

And it might still happen.

Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @09:20AM (#16257600)
Sure I can. Reason: power balance.

And sure there can be all the time ww3 and more. But the topic is, the more technology and the more powerful, the more disastrous can be the result if things go wrong.

Even with simple awesome things as gasoline engines - great benefit. But now we have pollution and climate change (mainly) because of them.

And if we invent a quantum warp drive whatever thing, then the benefits/potential disasters are even bigger. That's the nature of power. Technology is power. It can be used for both, or can be disastrous, even with good intentions. We as humanity "just" have to struggle to learn how to deal with that sudden increase in power. And there are still humans living in caves, stone age style. If you give them suddenly the ability to blow things up big, it is maybe just too much for them to handle ...

Re:AI is going to supercharge surveillance by jacquesm on Monday January 29, 2018 @09:38AM (#16257713)
We got this close to WWIII several times in spite of all the safeguards in place. Atomic bombs by themselves do not prevent war at all, they are weapons and sooner or later those tend to be used. All it takes is more and more proliferation, at some point some idiot somewhere will throw a match in the tinderbox and then it will be game over.
Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @10:01AM (#16257825)
So you argue for a stop in technological progress? As my point is every powerful technology can lead to catastrophic events?

edit: so downvoting is considered a argument?

Re:AI is going to supercharge surveillance by CogitoCogito on Monday January 29, 2018 @12:20PM (#16258920)
I don't want to speculate as to his intentions, but I see nowhere in this post where he argued for a stop to "technological progress". I don't even see an implication thereto.
Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @12:46PM (#16259158)
Well, yes, I might have argued against a straw man there ..
Re:AI is going to supercharge surveillance by wu-ikkyu on Monday January 29, 2018 @12:17PM (#16258891)
Downvoted you for your edit about getting downvoted, the HN guidelines forbid commenting on voting
Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @12:07PM (#16258776)
Or what are you arguing for? To reduce or ban nuclear warheads? Yeah well, I am all for it. But the topic was powerful and therefore dangerous technology in general.

And the more technological advanced a society becomes, the easier it will also get, to just make new nuclear bombs, viruses, killerrobots ect.

So my argument is, we just have to learn to deal with that power. And I believe we are not doing so bad, because there was no nuclear war. Despite all the tensions.

And your point is?

Re:AI is going to supercharge surveillance by oldcynic on Monday January 29, 2018 @11:14AM (#16258297)
I'd argue that NATO was far more the reason we did not have WW3 than nuclear capability and the power balance of MAD. Power balances tend to lead to arms races.

After all even with nuclear weapons and power balance we still had Korea, Vietnam, Cambodia, Iraq, Afghanistan etc. Any one of those could have escalated. A minor Venezuelan Crisis, and a shooting in Sarajevo escalated all the way up to WW1. Not to forget the role of the UK-Germany naval arms race of course.

Re:AI is going to supercharge surveillance by jacquesm on Monday January 29, 2018 @11:39AM (#16258501)
And the EU. Historically the European mainland has been the theater for these big wars and the EU has in general helped to reduce tension between the nations that had been more or less at a continuous state of war for centuries in some place or other.

With the new attacks on the EU and Russian funds flowing to EU skeptical parties (to give them a nice name) there is a good chance we will see a resurgence of war on the European mainland.

Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @12:27PM (#16258985)
WW1 happened, not because of the assassination of the crown prince of austria (which is something different from "just a shooting" though) but rather because allmost everyone was eager for war. Cheering people happily boarded the trains to the fronts.

In WW2 less so and so the other main reason for no WW3 was WW2. At least for europe. People were sick of war, therefore the EU. But soviet Russia and US would have still very like fought(and so whole NATO as well), if not for the shared fright of nuclear holocaust for everyone.

Also, back then, war was normal. If states had a big problem, they fought it out. Today this only works against small, weak states, but the big ones simply can't risk a war, as it becomes too disastrous for both sides. Because of technology. So yes, nuclear bombs were used twice, but then people really considered ... this is something new. This changes the rules, so maybe we have to find a way without war ...

Re:AI is going to supercharge surveillance by tinymollusk on Monday January 29, 2018 @12:28PM (#16258994)
If you apply this standard (requiring a control) to all history, one is forced to conclude that all conclusions about the cause of all historical events is bunk.

I think I actually agree with that.

Re:AI is going to supercharge surveillance by WillReplyfFood on Monday January 29, 2018 @09:36AM (#16257702)
The problem with secret services is that nobody by definition keeps them in check and balances. They can easy fake and create the reasons necessary for theire power to continously expand.

To be honest though, i find the chinese social credit (sesame credit) system far more social chilling then cameras. If you are social isolated, because did not greet the police men this week, that is breaking people down to subatomic particles. That is a nightmare from which people do not recover. Cameras can be destroyed- one guy fawkes mask protest later a goverment can be gone. But if everyone is setup to shun everyone and theire are no masks- and people get not even to meet other dissidents, that is where evil lies.

Re:AI is going to supercharge surveillance by bsenftner on Monday January 29, 2018 @11:01AM (#16258211)
There are "trade secrets", as in how we do Process A better than some other group, and then there are "secret services": organized groups whose activity and purpose are "secret". Perhaps I am naive despite my graduate economics degree and 35+ years working in technology, but I do not see any long term benefit from any organization using "secret services". In fact, the short term expense to the organization is so high, coupled with the added risk of exposure and often organization threatening nature of exposure, I believe the use of "secret services" to be irrational power abuse and ultimately incompatible with an enlightened technological society, and a signal of mental illness by those in charge of the "secret services" employing entity. This is true for companies as well as nations, as well as parent teacher associations and local police. The creation and maintenance of "secret operations" generates too deep conflicts of interest for the majority of mature adults to endure without corruption. Plain and simple, and the biggest revolution our race has pending.
Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @09:59AM (#16257816)
"The problem with secret services is that nobody by definition keeps them in check and balances. They can easy fake and create the reasons necessary for theire power to continously expand."

Not true. You can have trusted elected people watching them, so secrets are still secrets, but trusted peiple who change regulary keep an eye on them. Accounting, requesting documenation, ongoing operations, practice, training, ect. That works as good as the political will behind it.

And sure, there can allways be black departments operating on black money, but this is a different story. I am talking about a government agency, not a secret society. But yes, the latter happens, when there is not enough watching.

And sesame credit I have to research.

Re:AI is going to supercharge surveillance by wu-ikkyu on Monday January 29, 2018 @10:08AM (#16257862)
If the secret services are keeping their operations secret, how are the "trusted elected people" supposed to keep what they're doing in check?
Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @10:22AM (#16257959)
How can they keep it secret when they need money to operate? So you just follow where the money is going, what people working on what. And when the controllers are competent, you can hide maybe small things, but not big operations as they need big money.

(and as I said, when there is black money, it is a different story)

Re:AI is going to supercharge surveillance by wu-ikkyu on Monday January 29, 2018 @11:52AM (#16258624)
How can you know where the money is going when they've never had to pass an audit?

https://en.m.wikipedia.org/wiki/Government_Accountability_Of...

Re:AI is going to supercharge surveillance by hutzlibu on Monday January 29, 2018 @12:49PM (#16259173)
Well, it is possible to change that, right?

Might be much harder for you in the US, also because of the whole black money thing (CIA and cocaine), but in general it is possible.

Re:AI is going to supercharge surveillance by wu-ikkyu on Monday January 29, 2018 @01:06PM (#16259321)
No, it doesn't seem very possible to accurately audit trillions of dollars of transactions in the biggest and most secretive organization in history. They've been trying for almost 30 years now to no avail, all the while their budget and power have been increasing.
Re:AI is going to supercharge surveillance by WillReplyfFood on Tuesday January 30, 2018 @01:59AM (#16263399)
They can organize money of grid.

https://en.wikipedia.org/wiki/Iran%E2%80%93Contra_affair (only time they got caught)

My assumption is they are also milking the mob.

Re:AI is going to supercharge surveillance by Quarrelsome on Monday January 29, 2018 @09:35AM (#16257688)
> I asked Hinton if he believed an A.I. could be controlled.

Ugh, that question just goes back to the boring pie-in-the-sky stuff. The interesting question is if the automated processes we build on these tools can be secured.

That's the terror the next generation has to live with. NNs can be so opaque it might be hard to tell if someone has tinkered with the input data/retrained it/overridden it. I shudder to think of all the legal implications. Like, in the above example a trout murderer could just flip some bits and nobody would know there are no more trout because the system is still reporting that there are lots of trout and the manual checks have gone.

Re:AI is going to supercharge surveillance by bsenftner on Monday January 29, 2018 @10:45AM (#16258109)
That attitude of "technical sweetness" is alarmingly immature. The reason to pursue dangerous technologies is because Pandora's Box is open, and it is every technically able person's duty to know and understand dangerous technologies so they can be understood, defused when necessary, and maintained without this damn theater the powers that be use to project everyone into children who must be coddled by the state.