Because there’s a high likelihood that that’s not at all how this technology is going to be spread amongst the population, or all countries and this technology is going to be way more than Einstein in a pocket. How do you even structure society around that? What about all the malicious people in the world. Now they have Einsteins. Great, nothing can go wrong there.

The risk is there. But it's worth the risk. Humans are curious creatures, you can't just shut something like this in a box. Even if it is dangerous, even if it has potential to destroy humanity. It's our nature to explore, it's our nature to advance at all costs. Bring it on!

>What about all the malicious people in the world. Now they have Einsteins.

Luckily, so do you.

This is where it all comes back to the old "good guy with a gun" argument.

There is a very, very big difference between "tool with all of human knowledge that you can ask anything to" and "tool you can kill people with".

* * *

What would that help? Counter mad-men with too powerful weapons is difficult and often lead to war. Classic wars or software/DDoS/virus wars or robot wars or whatever.

You can use AI to fact-check and filter malicious content. (Which would lead to another problem, which is... who fact-checks the AI?)

I’m thinking of AI trained to coordinate cybersecurity attacks. If the solution is to deeply integrate AI into your networks and give it access to all of your accounts to perform real-time counter operations, well, that makes me pretty skittish about the future.

For example, imagine AI outpacing humans when it comes to most economically viable activities. The faster it happens, the less able we are able to handle the disruption.

> How can this be bad?

Guys, how can abestos be bad, it's just a stringy rock ehe

Bros, leaded paint ? bad ? really ? what, do you think kids will eat the flakes because they're sweet ? aha so funny

Come on freon can't be that bad, we just put a little bit in the system, it's like nothing happened

What do you mean we shouldn't spray whole beaches and school classes with DDT ? It just kills insects obviously it's safe for human organs

We thought the same 25 years ago, when the whole internet-thing started for the broader audience. And now, here we are, with spam, hackers, scammers on every corner, social media driving people into depressions and suicides and breaking society slowly but hard.

In the first hype-phase, everything is always rosy and shiny, the harsh reality comes later.

World is way better WITH internet than it would have been without it. Hackers and scammers are just price to pay.

The point is not whether it's better or worse, but the price with paid and sacrifices we made along the way, because things were moving too fast and with too little control.