Yes, you're very pwned if somebody has access to your email account. But less pwned than if they can also access all your other accounts directly at the same time =)

Of course, combining email-based login with another factor makes it more secure again, I was just talking about one factor.