News for hackers. Stuff that matters.

adbrebs

> Seems from right out of the gate, they are breaking their own ethical guidelines as a cheap promotional tactic. If they care that little about themselves and a former president of the United States, what do they care about your likeness.

We state in our blogpost that we make an exception for Obama/Trump in order to raise public awareness. Both of them are regularly used in Machine Learning benchmarks (for example [0] [1]). Note that we don't allow users to generate from Trump/Obama's voice.

Once again, we care a lot about these issues and that's why we only allow users to copy their own voice.

[0] http://www.washington.edu/news/2017/07/11/lip-syncing-obama-... [1] https://www.youtube.com/watch?v=ohmajJTcpNk

These issues are challenging and suggestions about how you think the technology should be introduced/regulated are very welcome.

This is a good point, it's true that we don't mention it explicitly in our ethics statement. But it is in our evaluation agreement:

> (v) create a false identity or otherwise impersonate a third party on or through the Services;

section 3.A: https://lyrebird.ai/terms/evaluation

Unfortunately this is something that we can not enforce automatically.

We ensure that people copy their own voice by asking them to read predefined sentences (we use speech recognition to check that the sentence is indeed corresponding to the text).

Thank you for raising those concerns. We take those very seriously. You can read more about our ethical stance in this article: https://lyrebird.ai/ethics/

To recap:

- we want to start by raising public awareness about the technology and we did demos with the voices of Trump/Obama for that,

- your digital voice is yours, people can not use it without your authorization.

This is going to be very tricky! No clear answer to that, we are putting a lot of effort on research but our progress is quite difficult to predict.
You will be able to create a digital voice that sounds like you and generate any sentence from it.

And thanks, we are going to update the instructions to make them more clear.

Yes, it's actually quite interesting! It's a recurrent observation that we have inside the team with our own voices. Friends of the person usually better appreciate the quality of his/her digital voice. You can also observe these reactions to some extent on twitter: https://twitter.com/LyrebirdAi

Other interesting observation are the sentences that people generate for the first time with their digital voice...

Sure, good question!

There will be two scenarii:

- you want to use the voice of someone that has a Lyrebird account: he or she has to give you their authorization.

- you want to use the voice of someone who does not have an account. We have specific contracts for that. Say you want to copy the voice of Morgan Freeman, the contract will be between him/her, you and Lyrebird. We will also probably explore alternative ways for that.

We've fixed the bug!
Unfortunately for certain voices our model has difficulties to generate the very beginning of the sentence. We hope to fix this problem soon.

Some other people shared their voices on twitter if you want to compare: https://twitter.com/LyrebirdAi

The first version will only be an online API. I agree with you that we should eventually think about licensing it for offline/embedded redistribution.
Thank you for the feedback!

> It'd be nice if there was a way to tune a few parameters manually (tempo, pitch, etc).

Yes we are currently exploring ways to control the generation: volume, pitch, tempo, speed but also intonation and emotion.

Not yet. We are starting with a few developers/companies only and will expand it progressively.

What would be your use case?

Yes definitively, we are starting a private beta at the moment.
Thank you!

1) The research of the PhD and the startup are quite complementary at the end, so we hope we can continue doing both.

2) We didn't do demo day because we raised our seed round just before YC and did not want to raise again.

Thank you for sharing that! We had not thought about this specific use case yet. It's quite difficult to figure out which use cases are going to become the most popular.
For now, it works better with American English accent but it is still able to adapt to other accents.

Our upcoming versions should be more robust to different accents and we also plan to extend it to other languages.

Yes definitively! This is also something we are working on.
Thanks for pointing this out, this was reported by a few others. We are investigating it. For now, just refresh the page and it should work.

Launch HN: Lyrebird (YC S17) – Create a digital copy of your voice

Hi HN!We are the co-founders of Lyrebird (https://lyrebird.ai/) and PhD students in AI at University of Montreal. We are building speech synthesis technologies to improve the way we communicate with computers. Right now, our key innovation is that we can copy the voice of someone else and make it say anything. The tech is still at its early stage but we believe that it is eventually going to...

( Read More... | 93 comments | 154 points | on HN )