I was that nerd, although admittedly I was only in one real fight (in grade school) and I didn't have too many problems beyond that.

[edit] I guess I didn't see too much actual violent fighting otherwise beyond (I guess) normal making fun of / pushing around of nerds, although I did see a few fights between girls and some involving more metalhead/burnout types (in case anyone is familiar with the John Hughes High Schooler taxonomy)