I don't think the suggestion is that a country "needs" to take away freedoms as it grows larger or more diverse. It's just that a larger and more diverse country is simply more likely to have to grapple with tensions between different groups of people. This may lead to some freedoms being challenged.