The phone compass often works poorly near magnetic metal (which is… often). Once you start moving it will calibrate itself, but that can take a block or two of moving in a straight line in an urban area.

Mounting your phone on the windshield helps with GPS some, as does getting a newer phone with L5 GPS.