IANAPilot, but I got curious once upon a time and studied those. Short answer: yes, they will get confused, but they won't crash out of the skies. Those systems are designed to account for certain perturbations in magnetic fields. However, there are thresholds in place to return control to the pilot if the entire system craps out at that level.