You're absolutely right. That's why many companies will have weekly team calls and then someone will write down a transcript and email it to everyone. It's the best of both worlds, because you can react to emotional nuances, yet you still have an email that you can search for and re-read as a reference later.