that's literally no different than what Google Maps does in my car while in CarPlay mode. It's like Apple neuters it and don't give it full gyro/compass data, because when driving it constantly moves the "car" anywhere from 90 to 270 degress and keeps it there for a few seconds until it figures this out again. I checked all possible permissions and still can't figure it out.

Never happens on the Apple Maps, although I have 0 trust in siri and apple maps, especially when we travel to europe, i feel like i'm an experiment for apple to see how much off straight forward route it can make me take.