No matter what you choose in life, lots of people will think you did something wrong; no option ever pleases them all and many individuals seek something to criticize, an outlet for their own unhappiness; any risk is just blood in the water for them. Also, the more vision you have, the fewer people will grasp it until the results are sitting in their laps, and not always then. They generally are ignorant about your life, often about these issues in general, and it's none of their business anyway. Their opinions are a non-issue; don't let the ignorant masses drag you down to their mean. Are they so happy?

That said, if you step out of your comfort zone expect to get kicked in the teeth and knocked on your a--, concussed and feeling defeated, a little more frequently. As long as you know that's part of the process, you can get back up again. The ignorant masses will say, "see! I told you so! I knew that would happen", like the stock broker who always says the stock will go down and gets lucky some days. Their idiocy is just comic relief. Make sure you know who really is loyal and cares about you; you only need 1 or 2; they are your support.

A bit of a rant, but I hope that helps.