To be fair, looking at one's watch while in the middle of a conversation has always been a rude gesture whether the watch is smart or not. In some cultures, it's a deliberate gesture to indicate a lack of interest in the other person and/or the conversation.

It is rude, and exacerbated by smart watches; just not unique to them.