I might also be a bit worried as a speaker that people looking over the speaker list might think I was one of those that lead to the disinvite and thus be a poor person to invite if for no other reason than further hassle.