Does it really eat up all your time, or just your energy? I find side projects are great for getting that energy back. Don't plan for something epic. Start with light stuff, eventually it snowballs to more interesting things.

I played Dwarf Fortress before it was Dwarf Fortress; it was some weirdish game that you could run around and stab things, or use magic to teleport organs out of monsters. Minecraft when I first played was just something where you dig out a block and put it elsewhere. No combat, no crafting, just moving blocks around like old school legos.

If you want to quit, perhaps get your idea past the prototype stage.