I'm all for making performance a priority, but the IE team found a way to implement pointer events without sacrificing performance. Surely they aren't uniquely capable of this engineering feat.
In the long run, shackling the web to the iPhone 1's touch input scheme seems awfully short sighted. I don't know if IE's pointer event model is the best alternative, but touchstart/down/up/stop definitely isn't.
Lately, I've actually found myself lamenting that I needed to further optimize a couple sites so they'd run smoothly on Chrome and/or Safari, when they were already buttery smooth in IE. That's something I never thought I'd find myself thinking.
(BTW, I see that someone downvoted you, but that wasn't me. Your point about AJAX caching is a good one.)
I wouldn't be surprised if things get better, at least for Chrome, in the near future.
I feel that websockets is like the xml of this decade - "everyone is using it" so everyone wants to use it.
Pointer events would be nice, but using a polyfill isn't so bad. Even if they implemented pointer events, we would still have to implement a polyfill for backwards and cross platform compatibility.
For those of who complain of standards, look at the CSS Regions standard. It's dead and the only browser that has a strong implementation of it is Safari. Other examples of non implemented or partially implemented standards by the browsers: SVG animations, Server sent events, CSP, CSS filters, CSS Images Values and Replaced Content (i.e. cross-fade() images), Intrinsic Sizing, Media Capture and Streams, CSS Masking and Clipping, Web Speech API, CSS Clip paths, User Timing API, the list is endless.
Not to mention that IE and Firefox seem to be very slow at implementing any CSS styling related properties like CSS filters, masking, shapes, 3D CSS transforms (Firefox struggled for a bit and now IE is 'struggling' to implement them fully)