Try progressive enhancement, or at least graceful degradation. Displaying a freakin' search field shouldn't be that hard.

And finally, why not load the necessary polyfills and fixes on demand? When the old/slow browsers need time to get ready, a few hundred milliseconds more or less don't matter.