This board's mission is not to prevent an AGI to become self aware and destroy all humans as a natural conclusion of being self aware. Personally I think this scenario is pretty unlikely anyway.
You just need 1 crazy human and extremely strong assymetrical warfare. If you look at the cases when a human killed lots of people with a truck, and see that in 20 years with cheap self flying drones a crazy person can kill even more people, you can extrapolate this and get to a sad conclusion (at least I did that).
> I believe that there is a threshold of power beyond which nobody can be trusted. Where, in fact, it is impossible for any entity to even theoretically demonstrate the track record of judgement, responsibility and infallibility that would be necessary.
Also I believe it overestimates the power needed to kill all people.
How much time does it take for us to get to the point when an entity has live GPS coordinates of all people living in the world for example? Just 15 years ago this question sounded stupid.
If Elon on Mars and Peter Thiel in his New Zealand compound end up getting an AGI after the rest of us are dead, it just doesn't matter to me.
An ethics board would never be strong enough to stop AI development in the world if needed. We can't even limit CO2 output of the world with policy, and AI will be much more profitable than oil.
There's a strong agreement between most AI researchers that the biggest problem AI creates is the loss of jobs, and AGI is just too far to worry about, but I feel that at the same time they all hope to be the one who create the first AGI.