Ok, I don't know all that a watch is expected to do because I don't own one. But AFAIK, messages, fitness tracking, and remote controls do not need anything above what some e-paper can get you.

Now (after some time to think) I do think it's mostly a design restriction. Nobody was able to make an e-paper watch look futuristic and expensive.