It's a pejorative because it is a short-hand for a longer statement: "Yes, of course, we need ${X}, but not in my back yard."