This annoys me: at least say you're not going to make it. I don't expect you always to be free or even want to attend, but how hard is it to say 'Thanks but I can't come.'?