My advice came from academic EEs. In my youthful ignorance, I failed to consider the potential for biased advice. From people with no industrial experience.
As for employers, some interviewers grilled me about my education. Others I deduced by de-emphasizing my education in my resume.
But I never got advice encouraging me to get an EE degree as a way to get a "leg up" on SWEs. Most of the advice I got was that I was making a mistake, and should get a CS degree instead if I was interested in programming. I went ahead with the EE degree anyway, but it's never seemed to hurt me in the eyes of potential employers, at least not that I've noticed.
Can you say a little more about how employers held your education against you? I've also been asked questions about why I chose various aspects of my education and job history, but never assumed it was hurting me as long as I gave a reasonable response.