"I think that, if civilization lasts long enough, then sure: eventually we might need to worry about the creation of an AI that is to us as we are to garden slugs, and about how to increase the chance that such an AI will be “friendly” to human values (rather than, say, converting the entire observable universe into paperclips, because that’s what it was mistakenly programmed to want)."