In Brazil people will be glad you're trying and try to speak slowly in return.
Obviously YMMV, but your assertions are contrary to my experience.
Edit: Down-voted. Thanks for the reality check.
2nd edit: Up-voted, perhaps to compensate. Thank you to whoever did that.
That said, in small towns and villages, this doesn't happen as much. Seems to mainly be a phenomenon in Paris and other large cities.
Also, in Quebec this is never an issue. As long as you speak fluently, Quebecois are happy to speak with you in French.
But for the French it apparently is (and understandably so).
It may have changed now. I have been living in Paris for several years, speaking strongly accented french (but mostly understandable), and I have had no tolerance problems so far, except the occasional person who prefers to speak in english to me.
Langlands was once invited to lecture in France, and he chose to give his talk in French. Evidently his accent was not all that good, and the audience found it a bit painful.
Jean-Pierre Serre, one of the leading mathematicians of the 20th century, and a Frenchman, was attending the lecture that day. He interrupted to ask a question, in English.
Declining to take the hint, Langlands answered in French and carried on with his lecture.