It's not "just a label," it's a political viewpoint. Liberal/conservative aren't just funny sounding words we made up to describe different "teams." They actually have meaning behind them and describe a general set of held principles. It's perfectly normal to want a different word for a different set of beliefs.

I also didn't make any value judgments. I didn't say that my views were "much better," I just said that I don't identify with leftist political views.