If I did that, there would be an implicit "I'd like to know why" on the end of it, with the understanding that there might be a very good reason. But now that you point it out, I could see how that could come across as a criticism, too.