Keynotes are all too often (depends on the conference, of course, but I see it a lot) either marketing stunts by well known people or companies, or high-level philosophical talks (which can be extremely interesting, but typically less useful for actual learning). So you miss out on all of the other, potentially better for learning, presentations.

You also lose out on the (IMHO) most important and useful part of conferences: the hallway networking.