I mean if you don't care about the company mission (if it's mission based), you don't compare about your employees, your word, you don't care about your time or care that you sold people that you were going to take their money to build something... then yes there might be no "personal" downside.

Though if you don't care about anything in the first place what are you doing trying to build a company?