In 2022, the median ML researcher surveyed thought that there is a 5% or 10% chance of AI leading to "human extinction or similarly permanent and severe disempowerment of the human species," depending on how the question was asked.

https://aiimpacts.org/2022-expert-survey-on-progress-in-ai/#...