There is strong opposition to any sort of national registry which might be used to "categorize" citizens for any purpose. That distrust is further compounded by general distrust in a strong federal government.

The whole concept of a federal personnummer/identitetskort - in their Swedish incarnations - and any benefits/conveniences offered by that sort of system is ideologically abhorrent to a (large?) portion of the US population.