I'll admit that I've had very few opportunities to travel abroad thus far, but, for what it's worth, my experience has been the same. In fact, most people seem to be a bit gladdened to find that a foreigner (perhaps especially an English-speaking tourist) is making an effort to learn their native tongue. And also, likely, a bit amused by my shortcomings—but that's no big deal: it's how you learn.