Re:I made a talking emoji using regular emojis and JavaScript
by ajanuary on Tuesday December 26, 2017 @06:20AM
(#16008139)
I always thought an interesting project would be to use facial recognition to detect key mouth shapes to make better gifs of people talking.
[ Parent
| on HN ]
Re:I made a talking emoji using regular emojis and JavaScript
by falsedan on Tuesday December 26, 2017 @07:09AM
(#16008254)
Only a few sounds use lip shapes. Most sounds are based on tongue positioning. Compare ‘m’ & ‘n’ to… not making any sound with your lips together or slightly parted.
The only sounds I would be very confident at recovering sounds from images for ‘th’, ‘w’, ‘o’, & indistinguishable voiced/unvoiced pairs like ‘b’/‘p’ or ‘v’/‘f’. Basically, the sounds a ventriloquist has to cheat.