That sometimes happens, but often keynote speakers are left alone because nobody's interested in talking to them. Keynotes speakers are often prominent individuals from outside the narrow field of the conference, and often wildly misjudge what conference attendees will be interested in hearing about.