Works fine for me. As in, I set it to usb audio and it keeps the setting after I restart the computer or resume from suspend. Sometimes I want HDMI audio and then I switch the output using the Gnome volume app and that works as well.

If it's a PulseAudio issue, it's very likely that you can change something in a config file somewhere to change the behaviour to whatever you want.