Re:Why Are There So Many Rationalist Cults?
by bondarchuk on Thursday August 14, 2025 @04:34AM
(#44898162)
I think the big difference between our views is that you are taking the rationalist argument to be "from intelligence follows malice, therefore it will want to kill us all" whereas I take it to be "from intelligence follows great capability and no morality, therefore it may or may not kill us uncaringly in pursuit of other goals".
Re:Why Are There So Many Rationalist Cults?
by godelski on Thursday August 14, 2025 @05:14AM
(#44898400)
> you are taking the rationalist argument to be
I think they say P(doom) is high number[0]. Or in other words, AGI is likely to kill us. I interpret this as "if we make a really intelligent machine it is very likely to kill us all." My interpretation is mainly biased on them saying "if we build a really intelligent machine, it is very likely to kill us all."Yud literally wrote a book titled "If Anyone Builds It, Everyone Dies."[1] There's not much room for ambiguity here...
[0] Yud is on the record saying at least 95% https://pauseai.info/pdoom He also said anyone with a higher P(doom) than him is crazy so I think that says a lot...
Re:Why Are There So Many Rationalist Cults?
by bondarchuk on Thursday August 14, 2025 @05:26AM
(#44898466)
Yes, I agree they are saying it is likely going to kill us all. My interpretation is consistent with that, and so is yours. The difference is in why/how it will kill us; you sound to me like you think the rationalist position is that from intelligence follows malice, and therefore it will kill us. I think that's a wrong interpretation of their views.
Let's rewrite your comment with apples
Do you agree with your conclusion now? We only changed the subject, the logic is in tact. So, how about them apples?And forgive my tone, but both you and empiricus are double commenting and so I'm repeating myself. You're also saying very similar things, we don't need to fracture a conversation and repeat. We can just talk human to human.