Generally in Western countries, the groups that pay in and take out are quite disparate.

The universal basic income would be paid for by the upper and middle classes, and taken by the working class.

At least in the UK these groups are seperated enough that there's very little socialization between them, very little overlap in voting preferences, etcetera. Different cultures, within the same country.