The answer typically depends on the circumstances and how much is at risk. If you have a family to support and your startup does not succeed (especially in this difficult job market) then regret will likely set in.