(As a non-native speaker) several bits of the Japanese transcription were just Japanese-sounding noise, and the prosody was completely all over the place in the bits that were actually Japanese. The dub does get across most of the things being talked about, but I wouldn't consider it an acceptable dub (even for most of the bits where it is actually in Japanese).
I wonder if reason is that the dubbing works better between more similar languages and struggles when dealing with disparate languages. I don't speak Chinese or Korean, but it would be interesting to see how well their dubs are.
Can you do another video into Japanese, to see if it's just an issue with the Paul Graham video? Also, how about translating from another language to English?
Steve Jobs on death | Walter Isaacson and Lex Fridman (EN->JP): https://www.youtube.com/watch?v=6YiJLDhcWSI
Maybe it does better on longer videos, but as someone who is fairly well-versed in Japanese this one was not a good result either. There is also a bit of wonkiness in this one, where in the dub Lex says some of Walter's lines and vice-versa, and at one point both of them repeat verbatim the same exact translated phrase which doesn't correspond to anything said in the original.
I laughed because the voices are so out there, and then it made two little funny mistakes that caught me off guard when I was already laughing, so I could only switch to crying at that point.
I wonder if they're breaking Youtube's (and others) TOS by downloading the videos to work their AI magic on them?
Elon Musk on Joe Rogan, speaking Finnish:
Original: https://www.youtube.com/watch?v=8Nael8xcSus
To Finnish: https://www.youtube.com/watch?v=OOkOafhAsDE
I'm a native Finnish speaker and while it starts off a bit strange, when they get to the mid to latter part it is really incredible, it's like an alternative universe where they were somehow born Finnish.
Paul Graham interview "What are some common mistakes founders make?"
Original: https://www.youtube.com/watch?v=845O4RE1XDM
To Japanese: https://www.youtube.com/watch?v=Rq_G0VXJ1xk
This one didn't work out so well. While some parts are decent, others sound like nonsense. But super cool it included pg blowing into the mic in the translation!