"judging people in categorized groups instead of as individuals isn't very libertarian of you"

I think you're conflating Randian philosophy with greater Libertarianism.