Yeah, this is a major pain in the butt for me as well. I want to only use Safari and Firefox but they really should finally pay attention to this pretty intuitive feature.