It's been a few years since I visited Germany, but it varied quite a bit with region, level of education, and age (pretty universal among younger Gymnasiasten, very rare among older people in former East Germany, particularly more rural parts).

I have gotten reactions from "Why did you bother to learn German? Everyone here speaks English" to "Gott sei dank! Du kannst Deutsch" ("Thank god! You can speak German")