What we will get is the equivalent of a rifle in the age of swords. Maybe a machine gun, even.
I have an Android device. Google's face recognition is so good, that it was able to correctly identify people in photographs in very degraded circumstances (occluded faces, sideways, etc.). It's only a matter of time before this shit is used to track people in public places, allowing "law enforcement" to track everyone. Were you in the Women's March last weekend? Well, congratulations! You've won the "extra screening at the airport" lottery.
This is already happening. In the UK 'forward intelligence teams' (FIT) have been applying these tactics for year. There used to be a blog about this, FIT-watch dot something, don't have the UR' on me.
For applications that are cost-senstitive, we'll use AI alone. This creates a new industry in cheap intelligence, where human analysts have never been affordable.
Anti-human is the easy bit, and that fact terrifies me when I let myself think about it.
Self-replicating… well, eh. Do corporations that employ humans count?
Sentient. Hmm. We wouldn’t recognise sentient robots even of they built a neon sign and marched en masse through Washington demanding their rights — if that happened, we would tell ourselves it was a clever hack by pranksters or $disliked_nation.
Perhaps even better would be if the AI rarely interceded in the human politics, and in fact worked to keep it's involvement and control totally secret.
In our 21st century world, especially one that is ignorant of the existence of strong AI, it's trivial to imagine a strong AI being able to "bend the economy to build better things for itself" while remaining completely undetected... This is essentially an AI-driven (instead of human-driven) spin on the introduction to the book Life 3.0...
That economy would also be the global economy... Not just that of a city...
If you'd like, you could even imagine that occurring as we speak...
Corporations don't self-replicate, at least not intentionally. They tend to grow larger and larger until antitrust breaks them up. (This has happened enough times for me to suspect that it's how things generally work.)
Imagine how surprising an automatic door opener would be to a person living 150 years ago. It would seem as if the door "knew" they were approaching, and politely opened for them. Imagine how surprised we would be if Clippy understood what you were doing, and offered help that was actually helpful.
As AI advances and is incorporated more and more into everyday things, our environment will become a reactive, "intelligent" black box, and along the way there will be some sudden advances that may be very startling and surreal.
https://en.wikipedia.org/wiki/A_Fire_Upon_the_Deep
This novel is full of ingenious ideas, one of which is demonstrating how huge differences in computing (=thinking) speed make up for fundamental differences, which manifest on many levels.
AI that's super-accurate at identifying potential terrorists might be a threat to me if I'm living in an authoritarian police state, but the police state is a threat to me without AI, and probably somewhat more preventable than AI surveillance. On the whole, I'd probably rather local police and intelligence services used a perfect profiling system, in the extremely unlikely event of such a thing ever existing, to using the guesswork they do now. Much more threatening to me and much more likely to be actively being used is AI that's actually pretty weak at identifying potential terrorists but trusted because it's pretty darn efficient at finding something that's difficult to explain on targets' computers. Same goes for AI databases purporting to be super-accurate crime prediction or credit granting or job selection models that are too intractable for anyone to realise they're basically doing the same job as a guy building a race and class based regression model. And of course where it comes to cyber-battles, the guys on offence tend to have a lot less need to worry about the accuracy of their AI's targeting and whether it's vulnerable to being gamed or just plain rubbish than the guys on defence
I agree about this for the foreseeable future, but it seems off topic. The article doesn't suggest anything like this, does it? I'm worried you might just be responding to the title.
And defence is possible, it just takes due diligence. Or in this fantasy future of yours, an AI that probes your business for you 247 and fixes security holes it finds.
Honestly, I expect doom and gloom AI posts in the media, not on HN where people are expected to have some notion of an IQ.
AI will be like Internet. When we in the year 2040 take a look at the last 40 years, we can't point out when it exactly became prevalent. We just know that at 2000 it was not a big deal, but at 2040 it is a very big deal and shaping the world.
For example, take self-driving cars. Formerly all you could do if you had a remote execution exploit was smash running cars into ditches or oncoming traffic. Bad, but not the end of the world. Now you can take 200k Teslas and very easily target every gas station or other soft target in the developed world. (I'm actually concerned about this, see https://www.zachaysan.com/cars for an, admittedly long, take on the matter.)
The same is true with AI everywhere. Don't read individual Twitter accounts, scan them all, build a data model to target the influenceable influencers. Iterate.
Don't try to get your honeypot to date the head of Goldman Sachs, use data science to figure out which 1000 25 year olds have a good shot at heading it up in 10 years.
The cyber game / international relations is about to get much more extreme. Offence is so much easier than defence and AI is turning every little touch of exhaust data or device into a tool of war or espionage.