The problem is that Libertarians have yet to explain their philosophy in such a way that non-libertarians would understand. "You don't understand" is the most common thing I hear when talking to a Libertarian. After awhile one just gets tired of it.