Well, people have stopped using it literally, so I don't see what it can be except a pejorative for subjectively "old" people, usually. If you actually argue that people younger than about 55 aren't boomers, you'll just be told that's not what the word means any more.

If you are a boomer, then I agree, why should you feel insulted?