I went to Iceland 2 years ago, and visited both Reykjavik as well as the entire country. As an Asian person, no one assumed I speak any Icelandic and spoke perfect English to me. :) But I did learn to pronounce Icelandic names; by the end of the trip, words like Eyjafjallajokull was not an issue.