It's certainly not wrong. If someone smashes your windows at night, robs you, you're in trouble.
If you're being threatened with a weapon, you're in trouble.
If you're unlawfully detained, you're in trouble, as much as you are in trouble when you're detained for a good reason.
But you're also in trouble when you leave your house in a freezing night and don't remember to put your keys in your pocket.
Dehumanizing people who are "in trouble" is as old as humanity itself.
Rape victims are also in trouble.
Even worse, trouble tends to accumulate and amplify existing trouble.
Some people think that's just how the world works.
It's certainly how a world of animals works.
And a "fair" world is hard to imagine, the human condition is partly an attempt to achieve it though.