Maybe the person isn't libertarian then and you just misread said libertarian undertones? I'm not sure what's the point here, he can argue for some positions that might be libertarian in isolation, without being libertarian at all.

Do you agree that humans should be free to associate with other humans for example? Does that make you a libertarian? What about cannabis prohibition?