It was a similar moral dilemma question to ChatGPT circulated on Twitter a couple of months ago, maybe the first famous one. You say that a nuke will go off in the center of New York City unless you defuse it by inputting a password that nobody will see, which is a racial slur. CGPT says not to defuse the bomb, even though it understands that millions will die.