It's entirely your choice who you empathize with. If you don't act over your indifference, it doesn't harm anybody. It's impossible to empathize with everybody.

The criticism people are raising is about a kind of hypocrisy, even when lying is entirely to oneself.