Re:Show HN: ML paper podcast generator using GPT and Tortois...
by ax8080 on Friday January 27, 2023 @02:07PM
(#34550274)
WOW! What do you use to generate voice? It's SO scary similar to real podcasts.
I couldn't find it in a minute in the sources.
[ Parent
| on HN ]
Re:Show HN: ML paper podcast generator using GPT and Tortois...
by carlbarrdahl on Friday January 27, 2023 @02:19PM
(#34550464)
It's making an api request to play.ht:
https://github.com/yacineMTB/scribepod/blob/master/playht.ts...
Re:Show HN: ML paper podcast generator using GPT and Tortois...
by tehsauce on Friday January 27, 2023 @02:26PM
(#34550564)
How did they get to use the joe rogan voice though? It seems that one isn’t public?
Re:Show HN: ML paper podcast generator using GPT and Tortois...
by nielsinho on Friday January 27, 2023 @02:43PM
(#34550765)
It uses the TorToiSe TTS model for generation. It's simple to generate conditioning voice latents using short audio samples. Likely transcribed JRE episodes were part of the TorToiSe training data, explaining how it's so good at recreating his voice characteristics in particular.
Re:Show HN: ML paper podcast generator using GPT and Tortois...
by windsignaling on Friday January 27, 2023 @03:03PM
(#34551053)
I wonder why the title says that it uses Tortoise TTS?
Also interesting that play.ht allows you to clone others' voices.
Re:Show HN: ML paper podcast generator using GPT and Tortois...
by ax8080 on Friday January 27, 2023 @02:11PM
(#34550339)
and it's funny how sometimes it makes ahhrhrhrhrhhhhh sounds
what is the reason behind that?
Re:Show HN: ML paper podcast generator using GPT and Tortois...
by nielsinho on Friday January 27, 2023 @02:50PM
(#34550860)
It happens quite often with TorToiSe that it collapses in this way. Especially for unseen tokens that wouldn't have appeared in the training data, which likely consisted of a lot of transcribed stuff and read text like audio books. Trying to make it laugh by prompting it with "hahaha" (which you won't really see in mentioned data) often gets you demon and zombie noises.
Re:Show HN: ML paper podcast generator using GPT and Tortois...
by qup on Friday January 27, 2023 @02:18PM
(#34550444)
Play.ht
Re:Show HN: ML paper podcast generator using GPT and Tortois...
by yacine_ on Friday January 27, 2023 @03:31PM
(#34551410)
That generation uses tortoise-tts. Play.ht has a model called peregrine, I've taken to using a script to call them out. Super cool company & API. I just haven't had time to get my next gen version out.