It doesn't. The policy of restricting Commonwealth immigration was brought in after https://en.wikipedia.org/wiki/Expulsion_of_Asians_from_Ugand... in response to complaints that there were "too many" immigrants.