I guess the argument is, that so far no one showed good examples of how would that lead to a total extinction. How would it start, etc.

So it's kind of a (fallacious) argument against "black box"-ing the whole intelligence explosion problem. If you can't define it, you can't analyze it sort of thing.

What I stated was that there isn't even a sound/reasoned example as to how a it would escape its bounds unless purposely authored to and even then you run into the scenario of human limits (its creator). Also, having no understanding on how AGI is structured, it is quite foolish to talk about bound leaping in the traditional sense of tech which is mainly associated with computer viruses that are purposely written for that sole purpose. There's nothing to even suggest you can purposely author AGI in such a fashion. So...

> How would it start, etc.

There has been no credible framing on how it would even start. As such, it's a null point of discussion.

> If you can't define it, you can't analyze it sort of thing.

With no definition, you can 'attempt' to analyze it and you'll likely be horribly off the mark, wasting tons of resources, and likely produce something that has no bearing on the real thing. Instead of admitting this, it's like people put full faith in these efforts being sound when the reality is the exact opposite. Why engage in this, unless your aim is profit/notoriety, when you could be working on the actual problem? Define intelligence [first]. Time to be honest with oneself. Time to stop projecting ones shortcomings on others. Time to stop using fear/uncertainty/doubt to obscure one's true intent. Time to stop pushing the disinformation cloud. Time for TRUE intelligence.

By the same logic there could be no virus which will exterminate humanity, because there was no precedents and we don't know the structure of such virus. Right?

> But what will stop them at the beginning?

Themselves of course. You are after-all your own worst enemy. I don't think people appreciate the incredibly slim number of individuals who are actually capable of pursuing this problem through to fruition and what their natures necessarily have to be. Do people not know of the types of individuals whose work is still being dusted off and relabeled as modern day achievements by others? The thinkers and creators of the previous AI age had certain characteristics. Certain character flaws and natures preclude you from probing certain subject matter. If you don't know much about yourself as a human being and your creation... If you haven't conquered aspects of yourself, how do you imagine you magically become capable of replicated it another domain? You don't. It's a non-starter which is why there is so much wheel spinning going on even with billions of dollars of resources and top ranking engineering talent. I really don't think people appreciate how fundamental AGI is. Look in a mirror sometime. All the answers are right there if you can find them/recognize them. Always has been.