This used to annoy me as well until I realized it's a very minor inconvenience compared to the benefit of not having my location data collected every time I search.