Here's a quick illustration:
Ad Hominem: Jeff Attwood gets off on being an ass. Therefore he is wrong.
Not Ad Hominem: Jeff Attwood gets off on being an ass. Incidentally, he is also wrong.
Seriously, understanding of logical fallacies seems to be in very short supply around HN. If I didn't know any better I would think I'm over at Reddit.
It does not mean an argument in which a person insults the person claiming the thesis. Insults rarely add anything to an argument but that is a different matter.
Also note that an ad hominem doesn't need to be insulting - it could be a very polite statement such as "This argument is incorrect because Mr Atwood is unqualified to discuss matters of education as he is not himself an educator". This is not really insulting (though I would argue that Jeff is in a way an educator) but is still an ad hominem.