That sounds normal to me. Getting over anxiety requires exposure and most people aren't doing a lot of public speaking on a regular basis. Toastmasters could help with that if it really bothers you.