I've also heard "it's better to finish something than to start something." At the same time, don't fall for the sunk cost fallacy. Finishing a dead idea only makes you feel good.