I think the argument is that decision theory and goal alignment can be worked on without knowing all the details about how an AGI will work.
https://intelligence.org/2016/12/28/ai-alignment-why-its-har...
ah yes Yudkowsky, the well established AI researcher & definitely not a crank
Personal attacks are not ok here, regardless of whom you're attacking. Can you please not post like this to HN?
Makes no sense to me, how would you ever be able to figure out a way to make something safe before it even exists?
Someone who has never built a nuclear reactor most likely could not think of a way to prevent the Chernobyl disaster.
(OK, maybe this is a wrong example as someone who did couldn't do this either, but the point should be clear)