Bangladesh has aboriginal people too. There is zero chance in hell we ever give back the land. Why should we view the British any differently?

The problem with your line of thinking is that it’s never applied equally. It always ends up with only white people being assigned moral agency.