Nah, it's fine. I charge my Apple Watch for 15m before bed (to make sure it'll last the night) and while I get ready in the morning, and that's all it needs to stay on my wrist literally the rest of my life without ever coming close to running out of power.