That's the argument that the British Museum uses to justify its collection (much of which was obtained through colonialism). Many countries (even Western ones like Greece) would like their stuff back.