Most “bad people” don’t have power or aren’t capable.

There are some powerful and highly capable evil people. I’m sure they are already stakeholders.

Sociopathic billionaires in bed with Trump and containing Musk and Zuckenberg.

Hmm, imagine a more emboldened, more determined, more dangerous Russia.

Forget russia, we have emboldened, determined and dangerous fascist USA already to worry about.

if you ever hear the phrase "global ai governance", ingest the context very slowly.

it was everywhere last week.

i would say, this has been the plot of the graph for at minimum 25 years with the NSA/DHS and data sharing.

we have two primary aggregators currently, the usa and china... all that needs to happen for us to cede humanity is to lose one of them.

we are in a really bad spot right now vs silicon.

edit: spelling.

let's not single out the defense contractors specifically, goes back further and is rooted in our behavior and desire for better organization through software.

https://en.wikipedia.org/wiki/IBM_and_World_War_II

Say more? Please. As in, everything after “last week.” Take us back, if you will.

so let's roll right over the fact that this is a very dangerous double entendre that i am pointing out, nevermind that you're not responding en merit to my assertion.

it's like slandering bitcoin over here you're all heavily unvested.

google kagi yahoo bing duckduckgo yandex archive yadda yadda yadda 'september transcript global ai governance'.

I don't need to imagine what I can see in front of me

A subset of the builders of the current generation of AI systems literally hold death cult beliefs i.e. that all humans should effectuate the transition to a world run by only AI, without humans at all. These are the worst people in the world to be driving advanced AI development, from any reasonable human perspective.

On a question of morals, conventionally bad people generally don’t desire the end of all humanity.

Indeed. No doubt they're shocked - shocked! - when their models keep escaping.