Google does a lot of personalization of search results. But if you don't give it your searches, it won't know what you want. So when you come back after switching, it's much worse.