Look into methods like extended kalman filters to mitigate some of this. It's a smart way to blend multiple sources of information and checking amount of error in real time to weight / bias one source of information over the other.