Malice is one possibility, but I think indifference is more likely. Such people are the ants about their feet; they aren't usually going out of their way to step on them, but they are also not particularly troubled if they do.