I forgot this wasn't a native feature.

Samsung/OneUI has a good few addons like this. Ability for multiple apps to play sound is good too (same addon) and the ability to output different apps from different sound devices at the same time (built in)