Uh, I can't say I've ever had this happen to me as an IC, even when I was brand new. Maybe one or two people will decline, but it's almost always because they just have a conflict or something.

What you describe sounds totally dysfunctional. If someone is calling a meeting, I assume it's for a good reason from their perspective (even if I think the assumptions they're making are dumb or something).