I joked about vibe coding the solution to this but I did have Claude tell me how to fix it and apparently there is a config to change search sources.