Yes I go up and talk to people that ride segways whenever I see them usually in malls and the like and most use them because they are partially handicapped and have trouble walking and the segway makes them look normal.

I'll second that. I have a relative who can stand fine, but can't walk for long distances. The Segway makes it possible for him to travel distances that he otherwise would not be able to travel. He doesn't look like a dork when he rides it (in my opinion). Perhaps everyone just assumes that if you own a segway you are a pompous windbag with more money than sense. I wouldn't be surprised if most people see it as a luxury item that only the "elite" can afford, and therefore they resent the device's presence (as well as the rider's). Perhaps calling the person lazy is the best thing they can come up with which is derogatory. "Get that thing off the sidewalk you rich jerk" probably doesn't seem to have as much sting.