My experience with captions is that it fails hilariously when the person speaking is not a native speaker and not completely fluent. You will understand the point they're making with reasonable accuracy, but if you only read the captions you would not have anywhere near the same understanding it at all.
I think the option to save the transcript is available only to the organiser of the call.
I was the organizer but didn't see it. Another coming up in 3 minutes, will look closer this time!
I checked the online documentation again and there is no mention of recording the live captions now. I am very confident that, a few months ago, this option was there for the call organisers.
People expect there to be no log for phonecalls, and that extends to video calls. Google might well keep a log for themselves, but if they sent it to participants, they would alienate many of them.
PartA: Who's going? PartB: I'm going. PartC: When is it?
What boggles my mind is why it doesn't immediately after the meeting end, Hangout would send you a transcript of the meeting. This would be a crazy USP.