A completely separate problem. If you're not grounded in reality, it doesn't matter if you're operating in a deontological or consequentialist mode. You can justify bad outcomes with either.