Wrong is wrong, and if it _isn't_, then it just matters who gets away with it.
EDIT: Pushed to its bloody asymptote, this suggests that the only thing to be done if your ancestors incurred a blood debt is to finish the job, since you will be perpetually judged evil. Might as well be evil and also without the inconvenience of those your ancestors wronged.
This is the message we send people when we tell them "bUt ThInK oF tHe CoLoNiZaTiOn YoU'rE eViL". No group in history has ever benefited from stepping down from a position of power and prosperity, regardless of how they obtained or inherited it--doubling down on that nonsense and also telling them that they're evil no matter what they do is a great way of ending up with folks happy to double-down and revive the policies of their forebearers.
When faced with this nasty brutish truth, people like you don't have anything to fall back on other than clutching pearls and apoplectic whimpering about justice. You all have pushed too far for too long against something that is too obvious, and in doing so you have empowered the worst sorts of people to rally. Integration should've been the goal, not flagellation, and instead we've caused these assholes to embrace the strategies and mindsets that served their own ancestors so well.
This is literally the opposite of cause-and-effect, and also a horrifically simplistic—even elementary—ethical model.