The gym I went to had almost exclusively very fit people, who obviously exercised a lot.

When I started out I was fairly overweight and completely out of shape, could barely do a couple of pushups, and I felt very uncomfortable and out of place.

However the others just did their programs, and I never got any looks or comments. So after a while I managed to relax and just get on with my own stuff.