Re:I made a talking emoji using regular emojis and JavaScript
by _nalply on Tuesday December 26, 2017 @04:50AM
(#16007926)
Lipreading is different. For example the «sh» sound is made by slightly pursing the lips but not all speakers do this. In German it gives a very clear visual picture.
[ Parent
| on HN ]
Re:I made a talking emoji using regular emojis and JavaScript
by falsedan on Tuesday December 26, 2017 @07:01AM
(#16008232)
I would only purse my lips if I were performing a shush. In words like ‘hash’ I’d just close my mouth slightly & leave lips parted and wide from the ‘ha’ sound.
I agree that the mouth shapes are garbage in this demo. A shame because that is the most interesting & important part of animating speech.
Re:I made a talking emoji using regular emojis and JavaScript
by maury91 on Tuesday December 26, 2017 @07:27AM
(#16008303)
This demo is done with my nearly 0 knowledge in lips reading, the effect I was searching was to make it more realistic, but with the limited amount of usable emojis I cannot have it very realistic, just better than random. At the end of the article I propose some gotchas to improve it: use better images, use a better map.
I'm happy that this article has triggered some people curiosity and can maybe evolve in something more advanced
Re:I made a talking emoji using regular emojis and JavaScript
by _nalply on Tuesday December 26, 2017 @07:44AM
(#16008358)
That's why I am bad at lipreading in English. People have mouth shapes all over the place. I'm sure I could learn lipreading a friend I meet often well, however this doesn't help lipreading a stranger. When traveling in the US I always have a notebook ready.