It can be styled with css.
Edit: Example: https://gist.github.com/fzzzy/f5f1af66ee8fff478ffb3698ac9f80...
You can style it normally. They just don't like the default style.
Edit: Example: https://gist.github.com/fzzzy/f5f1af66ee8fff478ffb3698ac9f80...
And it can't be styled without JavaScript? That's how it works with <audio>. So utterly frustrating.