I understand where your coming from and I'm sure theres a happy medium. Doing just money or just enjoyment wont work as well as a proper balance.

But, to play devils advocate... Having worked in a high paying, crap job and moving into a job with lower pay but much more aligned with my passion I am MUCH happier