It's not about 'constantly working' (I don't), it's about having lots of things that I like to do, plus work. I think even if I were wealthy and didn't have to work I'd find more ways to fill my time than time available. In some ways that's good - I don't remember the last time I was bored - but it does mean my time is limited.
I guess the point is that for me, exercise is probably more efficient, time wise, in terms of benefits/time, and also includes some of the mental things that I think meditation must give you, but of course it's a fairly personal thing, and to each his own.
If you're "constantly" working, then that's a choice you made, right?
[edit: just realized I sound kind of like an ass. I shouldn't speak for other people. Just read this as me talking to myself :)]