Nah. Mathematics is kinda like "brain gymnastics": you'll have a hard time starting but it'll become easier as you go through it.

My advice is to find a place/community where you can ask "stupid" questions without being judged too much. For this kind of questions, every once in a while, I like to ask on usenet, on the sci.math newsgroup.