Neural Codec Language Models Are Zero-Shot Text to Speech Synthesizers

Re:Neural Codec Language Models Are Zero-Shot Text to Speech... by orbital-decay on Friday January 06, 2023 @02:36AM (#34271975)

Yes, but can it be used to express emotions? Can it derive emotions from the text alone, without the painstaking guidance? That seems to be the main culprit with existing TTS engines; neutral tone can be generated relatively well.

[ Parent | on HN ]

Re:Neural Codec Language Models Are Zero-Shot Text to Speech... by vanderZwan on Friday January 06, 2023 @07:44AM (#34274045)

Honestly I suspect some kind of "emotional markdown" would be more useful if it has a light and intuitive syntax

[ Parent | on HN ]

Re:Neural Codec Language Models Are Zero-Shot Text to Speech... by com2kid on Friday January 06, 2023 @10:26AM (#34275690)

Humans can't drive emotions from text alone without external contextual clues.

Such has been the source of much miscommunication online.

Amateur fiction writing, which tends to overemphasize how things are said ("I guess I can go rescue your cat", the exasperated detective said wearily) might be easier for AI!

[ Parent | on HN ]

Re:Neural Codec Language Models Are Zero-Shot Text to Speech... by Valgrim on Friday January 06, 2023 @04:02PM (#34281015)

Sure they can, that's the whole point of acting. Also anyone who ever read a story to a kid can infer emotions from the text itself.

[ Parent | on HN ]

Re:Neural Codec Language Models Are Zero-Shot Text to Speech... by com2kid on Saturday January 07, 2023 @08:25PM (#34295015)

To a limited extent, sure, but kids books are also written to be very emotive.

The linked page actually has examples of the same text being read with different emotions, demonstrating that for even a single sentence a lot of variance is possible.

[ Parent | on HN ]