I ended up writing a wrapper around youtube-dl and ffmpeg to download the MPEG-DASH video and audio streams and mux it because of this. It was a spur-of-the-moment hack, so don't expect error handling.

https://github.com/rahulg/dotfiles/blob/master/tools/dashtub...