If nobody depends on your steady salary and you have an idea you're passionate about, you should pursue it.

Even if you "fail" in the financial sense, you'll have significantly more experience than others who list more "years experience" on their resumes.