The golden rule in my experience is that you can have both, if being careful in the proportions. Usually I limit new things to 1-2 concepts/tools a time, and use well tried ones for others. This way I usually manage to get stuff done and avoid getting stuck in my comfort zone.

Note: I have some hobby projects with minimal progress, where I ignore the golden rule and try new stuff all the time :)