I had a slightly weird schedule, and didn't end up taking E&M until way after I had finished all four semesters of Calculus. I walked out of the Calculus series being able to turn the crank quite well, but I didn't have a very good feel for what it meant. E&M made all the difference!