One of the great functions of a smart watch (or other fitness wearable) is sleep tracking. If you have to take it off overnight, you can't do that.

I charge my Pebble once a week. Before that, wearing a bog-standard digital watch, I took it off ~never.