> There's also this thing with having a "soft voice", that's something much more often attributed to women than men (IME – can't remember hearing that said about a man, like, ever).

The "soft spoken" is used for men.