I don't knwo Android Auto, but Apple CarPlay. It's far from perfect, but I had a whole different experience than you.

First time plugging in, a simple confirmation on my phone to allow connection. CarPlay starts, everything works out of the box. Now I can phone, can search my music library (try that with bluetooth) and I have a voice control that mostly understands what I want to play.