I think the question these days is "jQuery or vanilla DOM API?" and less "jQuery or JavaScript framework?"

Personally, if I'm working on a project that isn't big enough to warrant a framework, I'm probably not concerned about Internet Explorer either. (And even then my understanding is that IE isn't even that bad these days.)