The way EME is designed, the browser is responsible for fetching the data from the network and passing it to the DRM module. This is no different with MSE, as far as I can tell; what you buffer up is the encrypted data, then pass it on to the DRM stuff.