Right, I feel your pain, bilingual Android Auto sucks. I wouldn't use voice control to call someone (luckily there is a dedicated button on the steering wheel for that).

But for other stuff (changing tracks or albums - "play xxx from spotify") it works just fine for me. And yes, I use a louder "computer" or "command" voice when talking to digital assistants (had to learn how to do that to control Amazon's Alexa devices). ;)