But I’m pretty convinced that humanity’s survival will eventually depend on it figuring out how not to pursue certain avenues of research/advancement. I don’t think this is overstating the future risks we will face.
And for all of the value that nuclear energy does provide, it remains one of the most tightly controlled technological capabilities for good reason.
We could enslave x% of the population and use them as organ donors, we don't
We could use prisoners as free labor, we don't (in most of the world at least)
We used to send kids to work in mines, we don't anymore
We could reduce working hours and enjoy the increased of productivity per worker of the last 50+ years to retire early, we don't
We make a lot of choices, all the time. Saying humanity doesn't make choices is just accepting other people choices. If you think "everything new had to happen" and if "everything that is had to happen" then yes, we don't chose anything
even for the actions that humanity collectively found aborrhent you don't take action before the crime.
note I'm not dissing you because I do share the feeling that thing will be out of control real fast before getting better, but I just don't know how it can be otherwise. I'd say that we need to cross the moat as fast as possible, not pretend it's not there.