I think you may not be aware of the graylevels within that statement. It is true that the Slavery Abolition Act 1833 abolished the African slave trade. But you need to know the details to realize why the powers that be allowed that to happen. Also, it is worth mentioning that while the same 1833 act made an explicit exception for territories possessed by the East India company. Further, slavery was replaced by indentured labor. This is why you find large populations of non-African slave descendants in many countries. If you've ever vacationed in Trinidad, you'll notice lots of Asians (Indian, etc) people. They got there because their ancestors were brought as indentured labor to replace African slaves. In many cases, as is still occurring today in places like Qatar/UAE, indentured labor is just a #define for slavery.
"while nearly all other countries in the world at the time were totally fine with it". I guess this depends on how you define "country", but lets take it to mean the majority of a population. I'll give you that countries benefiting from the slave trade were clearly fine with it. I sincerely doubt the populations being enslaved were though. (their opinions count right?)
You can cast this in cynical terms as self interest, but you can do that with any action by any state in history - Britain is hardly unique there.
Its basic economics. Had the ruling elite deemed it necessary I'm sure Punch could have been commissioned to print all manner of xenophobic cartoons about subhuman slaves and their barbarism in order to justify the practice further.
This isn't to diminish the efforts of the anti-slavery movement or the individuals involved.
*Edit: Also, yes, this is not unique to any country at all. I'm sure there are a myriad of examples of slavery within any of the countries that Britain colonised throughout history.
Slaves made empires (true empires) possible because captive people are a net positive for the conquerors. You could conquer your neighbors and... sell them to pay for the war, which isn't the case today. Outside Syria, I guess. When the Roman Empire was at its peak citizens could pay their taxes with only two days of work per year.
What people forget is that the norms of the past are not the same as the norms of today. At one time, slavery was normal across vast swathes of the planet. That it isn't today, is in part due to a moral revolution that took place in Britain and resulted in a policy change by the British empire - despite its own commercial interests - to abolish slavery and the trade in slaves, even while nearly all other countries in the world at the time were totally fine with it.