Sorry, I didn't mean for it to sound as if I was speaking for you. What I meant was, if you were actually them, you would be doing the same things they are. Maybe this seems tautological, but I think it's an insight that helps one to be compassionate.

If my current mind were to be downloaded somehow into the other guy's body, would I be a border patrol agent? No! But that weird hybrid person never existed and never will. If I had been born as he did, and had the same brain, and gone through the same experiences (in other words, if I were actually him), I would be doing exactly the same things.

This realization that people are doing the best they can (usually very unskillfully) can help us be compassionate toward them.