My advice would be to use https://indieweb.org/POSSE That approach might be more agreeable with your label-mates.

I wouldn't put covers in the videos at all. You're right, that's a legal minefield. Just use original music that you have the rights to.