This is correct. It is always expected that foreigners will speak broken Vietnamese, and given that it is already rare in the first place to hear a foreigner speak Vietnamese, most will be delighted to see you do it, no matter how broken it is.
I suppose this is true of all tonal languages but Vietnamese is very unforgiving. Even when people really butcher the pronunciation and grammar of English I can still usually guess what they're trying to say. If you don't really nail the pronunciation and tones of Vietnamese people won't understand you at all. I've seen a lot of foreigners give up in frustration even after years of living here.
If you really want to learn to speak tiếng Việt you have to find a real teacher and drill the basics of tones and pronunciation. If you try to pick it up a phrase at a time chatting with people you'll never get it.
I also found out that after starting studying Chinese it is easier to me to understand Chinese people speaking Portuguese (my native language) because I understand a bit of the Chinese grammar and phrasal structures.
When other kids complained about our old Taiwanese teacher's English accent, I asked them simply: "let's say hypothetically we inverted the situation and found an exact parallel of your Chinese accent to her spoken English when Chinese comes out of your mouth, and you understand the accent is native. How hard will you laugh?"
The ASEAN languages, so Thai and Indonesian and Vietnamese, seemed so so much harder than Chinese. Not even sure why.
Mandarin was hard, with 4 tones. I think standard Vietnamese has ... five?
God help me if I ever learned Cantonese Chinese! I actually knew people from the south, and eight/nine tones made me wonder how they fuck people stop learning the language and move onto anything else.
Me: 200 characters of Mandarian
Southern Chinese Dude w/ College Degree: Spoken Cantonense with 9 tones and 20,000 chacters in Mandarin Chinese
Fuck my life.
Luckily the Vietnamese will almost always give foreigners a pass for making these kinds of mistakes and they're happy that you're even make an effort to learn their language.