I am concerned about that as well. I may switch to mute by default as soon as I connect and whenever I'm done talking to someone. I've been using Google Meet and I wish there was a way to persistently show the muted state. Fortunately, there's a ding when someone enters so even if I've forgotten to mute, I'll likely notice if someone starts listening.