I did the same, plus used Karabiner to disable the Touch Bar escape "key" and set the touchbar to only show volume, brightness, kbd brightness regardless of app running.

In that mode it's OK, but I still have to look down to mute the sound, which is inconvenient.