For many, it completely depends on time spent at work and effort spent at work. I've been on both sides. If you spend a lot of time and effort at work (not a bad thing), your desire is diminished outside of work. However if you don't have to spend a bunch of time/effort at work, there is time/effort available. Granted, even that relies on whether you enjoy it over other things, but you shouldn't be shocked.