Not a problem in practice. I crossed the border dozens of times with a TN (I actually lived in Canada but worked in the US) and know of many others. Generally as long as you aren't in violation of the intent of TN you should have nothing to worry about.