Stephen Hawking partakes in research, with Intel, mostly on speech recognition, to help him being able to better express himself.
Elon Musk funds several startups in the field of advanced AI.
And please stop with your arogant (and erronous) definition of what science is and science is not.
Higgs theorized the Higg's boson existence in the 60s, that could not be tested until 50 years later, are you saying this was not science? Einstein's general relativity predicted the existence of black holes in 1916, we still don't have definit, hard proof of their existence, is it not science? The Big Bang theorie has never been proven (data from last year BICEP2 experiment are still being dissected), is it not science?
Should we not talk about all this subjects because they are not proven?
What you are referring to, is the scientific method, which is the way we use to decide if something is sufficiently proven to be deemed as true or not, not the definition of science itself.
But how can you have something testable about something that does not exist yet? You would have to have evidence that an actual, intelligent program does something hostile, which is obviously impossible at the time since AGI has not been invented yet.
However, we do have evidence of naturally occuring hostile intelligence. If an AGI is vastly superior in some regards (for example through much tighter integration in knowledge and control systems), it could in fact pose a danger. The article even clearly states a hypothesis: "Humans, who are limited by slow biological evolution, couldn't compete and would be superseded."
We can’t really assign a probability of occurrence to scenarios like these, thus we have to include it in the list of events that could potentially wipe us out and which we may be able to prevent. Since people are actively working on AGI, it should probably be somewhere at the top where nuclear warfare, global warming and comet impacts are listed.
If someone more knowledgeable than me on a subject fears it, well I think it's worth at least listening to him. Not dismissing his concerns arrogantly.
And when those person are one of the greatest scientist and one of the greatest entrepreneur of our time, both with some kind of expertise in AI, well...