Keep your current jobs and work on your idea on the side until it hits an MVP stage and you can show it to people from your target audience. Only then depending pn the feedback decide if it to take on it full-time or to drop it. Chances are that it won't make the cut.