Google Research and Daydream Labs: Seeing eye to eye in mixed reality

Re:Google Research and Daydream Labs: Seeing eye to eye in m... by theptip on Tuesday February 21, 2017 @11:16PM (#13702962)

I really liked the approach that Oculus are taking and which Zuck demo'd last year[1], with cartoon avatars that are still expressive enough to convey facial expressions.

It definitely falls on the other side of the uncanny valley, and anyway, who is going to want to render a realistic version of themselves into the VR world, when you can be <insert favourite person/creature/character>?

That said the tech in the OP is very cool, and I can see plenty of use cases (e.g. business meetings or celebrity broadcasts).

[1]: https://www.facebook.com/zuck/videos/10103154531425531/

[ Parent | on HN ]

Re:Google Research and Daydream Labs: Seeing eye to eye in m... by carlosdp on Tuesday February 21, 2017 @11:38PM (#13703047)

Well that's designed for in-VR avatars, this method is designed for mixed reality videos (VR footage with the real-world person superimposed on it)

[ Parent | on HN ]

Re:Google Research and Daydream Labs: Seeing eye to eye in m... by gwern on Wednesday February 22, 2017 @11:09AM (#13706514)

In the FB video, I think the facial expressions were like emoticons: they had to be manually invoked. This approach could do it automatically in realtime, by mapping the facial movements onto a cartoon avatar (probably easier than onto the real face).

[ Parent | on HN ]

Re:Google Research and Daydream Labs: Seeing eye to eye in m... by theptip on Wednesday February 22, 2017 @03:54PM (#13709057)

Interesting, do you have a source for that info, or is that a guess?

Watching the video the eyebrow movements look a bit twitchy, I'd assumed they were face-tracking them. I have no supporting evidence beyond watching the video, so I'd be interested to know more details either way.

[ Parent | on HN ]