I've got a similar situation with a web app millions use, but a couple corner office people use IE11. We were able use an IE only CSS selectors to degrade; in theory you could do the same without compromising the layout for other users.