Re:Facial hair tracking for high fidelity performance capture
by staindk on Sunday July 24, 2022 @08:03AM
(#32212606)
I've linked to the publication but be sure to check out the video they've embedded.
Out of the handful of new publications they released today this one was the most interesting to me - I guess it's because this problem is in many ways more focused and less complex (seeming?) than the others (I'm not an ML/neural networks buff but do find it all interesting).
Re:Facial hair tracking for high fidelity performance capture
by vanderZwan on Sunday July 24, 2022 @10:12AM
(#32213694)
Very cool stuff.
This is a bit of a tangent, but why are the captures all toothless? Is there something in teeth that makes it hard to capture them? Or is it a conscious choice to remove them? I have the same question regarding the eyes.
Re:Facial hair tracking for high fidelity performance capture
by pfranz on Sunday July 24, 2022 @11:36AM
(#32214464)
The short answer is that they're only showing meshes that are deforming. Teeth are rigid and would be put back in based off the jaw and skull position. If memory serves, eyeball position tracking isn't great with this approach, it's not all that hard to add back in, and they often want to cheat eyelines anyway.
Re:Facial hair tracking for high fidelity performance capture
by staindk on Sunday July 24, 2022 @12:51PM
(#32215234)
I think pfranz is on the right track - in one of the other publications they released today they show off how their tech does jaw positioning based on certain constraints (it seems to know where the jaw hinges and how the jaw bone interfaces with the skull).
Re:Facial hair tracking for high fidelity performance capture
by dchftcs on Sunday July 24, 2022 @10:35AM
(#32213878)
My guess is that the teeth isn't visible throughout all the frames, so it's hard to reconstruct accurately in 3D. In fact the parts that look like gum and the tongue don't seem to be correct, far from the reconstruction quality of the face itself.
Re:Facial hair tracking for high fidelity performance capture
by t-3 on Sunday July 24, 2022 @11:08AM
(#32214182)
They're not? You can clearly see the teeth in the frames where they are visible in the raw. Teeth are just not commonly seen outside unnatural facial movements.
Re:Facial hair tracking for high fidelity performance capture
by xattt on Sunday July 24, 2022 @03:04PM
(#32216554)
Although this link isn’t it, I’m anticipating a time when facial hair tracking may become a proxy measurement mental health well-being - ie individuals who are usually clean shaven all of a sudden start having a five o’clock shadow.
Re:Facial hair tracking for high fidelity performance capture
by xattt on Monday July 25, 2022 @04:34AM
(#32221884)
Are you suggesting direct integration of the StubbleScan into PeopleSoft for automatic scheduling of mental health days and/or automated referral to the Employee Assistance Program?
Re:Facial hair tracking for high fidelity performance capture
by antegamisou on Sunday July 24, 2022 @10:13AM
(#32213700)
I suspect this is likely to be met with significant kickback, but I'm glad there are people publishing and researching ideas outside the cutting edge, yet easier to get grants for, ML/DL stuff. Not to mention that many researchers have noted the dubious quality of many papers in big ML conferences and no I don't believe they complain because theirs didn't pass peer review.
Reading about CS research here, as well as in other media, has become akin to TV zapping and always ending up with the same type of show on every channel.
Re:Facial hair tracking for high fidelity performance capture
by dahart on Sunday July 24, 2022 @01:08PM
(#32215430)
This is graphics research done by a private company, not funded by grants. Siggraph is one of the pickier CS conferences, even when it comes to applied ML. I'm not sure I understand why you think this would get any kickback, or what you mean by that?
Re:Facial hair tracking for high fidelity performance capture
by antegamisou on Sunday July 24, 2022 @02:03PM
(#32215984)
I supposed my original message might come off as anti-intellectualism towards ML research. This is personal but I think AI research* has become incredibly over-hyped, so for me reading about contributions to other fields is something more exciting now.
*referring mostly to applied disciplines. I cannot speak for theoretical ML research as I have not looked into it in depth.
Re:Facial hair tracking for high fidelity performance capture
by kadoban on Sunday July 24, 2022 @12:41PM
(#32215131)
Basically all women have facial hair, unless they've done something to remove it. I'm not sure if this technique would work on it though, it tends to be difficult to see clearly from a distance.
Re:Facial hair tracking for high fidelity performance capture
by kepler1 on Sunday July 24, 2022 @02:44PM
(#32216378)
How unprogressive of you to focus on male/female, while neglecting people with facial deformities or people who have excessive hair growth in non-traditional facial areas. You oppressor.
I'm glad you're injecting these considerations into every possible topic. We need more of it. That way I have someone to accuse of being inconsiderate, by finding the next category that we'll divide people up by.
Re:Facial hair tracking for high fidelity performance capture
by charcircuit on Sunday July 24, 2022 @01:42PM
(#32215783)
No, it doesn't. Eyebrows are considered facial hair for this. It mentions that currently males need to shave off their mustache or beard, but that is different from saying women don't have facial hair. Most people haven't shaven off their eyebrows.
Re:Facial hair tracking for high fidelity performance capture
by dotancohen on Monday July 25, 2022 @01:45AM
(#32220906)
This text from the fine article:
> actors are asked to shave clean before face capture, which is very often undesirable.
Had the additional word "male" yesterday:
> male actors are asked to shave clean before face capture, which is very often undesirable.
They actually went and changed the text! That is quite typically Disney, for better or for worse. The original text is luckily preserved at the Internet Archive:
Re:Facial hair tracking for high fidelity performance capture
by dahart on Monday July 25, 2022 @08:34PM
(#32232838)
I’m confused by your comments, which wording do you think it should have? Like parent comment already said, the presence of the word ‘male’ in that sentence does not imply an assumption that all facial hair is male; it can legitimately mean that only the male actors typically need to shave, which is usually true. Facial hair growth has sex based differences in humans, so I don’t see a problem with having the word there, nor with removing it. Why do you think it’s a problem either before or after, and why do you suggest that changing the text to fix the very issue you called out is a bad thing?
Re:Facial hair tracking for high fidelity performance capture
by kadoban on Monday July 25, 2022 @09:04PM
(#32233050)
It should probably have whichever text is most accurate to whatever actually happened or is happening.
So if they did/do actually ask only the male actors, it should probably say that. If they're asked only based on the characteristics of their facial hair, it could say that.
Out of the handful of new publications they released today this one was the most interesting to me - I guess it's because this problem is in many ways more focused and less complex (seeming?) than the others (I'm not an ML/neural networks buff but do find it all interesting).
This is a bit of a tangent, but why are the captures all toothless? Is there something in teeth that makes it hard to capture them? Or is it a conscious choice to remove them? I have the same question regarding the eyes.
I think I need a day off.
Reading about CS research here, as well as in other media, has become akin to TV zapping and always ending up with the same type of show on every channel.
*referring mostly to applied disciplines. I cannot speak for theoretical ML research as I have not looked into it in depth.
Why do you think people would have an issue with them tracking us furry humans?
I'm glad you're injecting these considerations into every possible topic. We need more of it. That way I have someone to accuse of being inconsiderate, by finding the next category that we'll divide people up by.
> actors are asked to shave clean before face capture, which is very often undesirable.
Had the additional word "male" yesterday:
> male actors are asked to shave clean before face capture, which is very often undesirable.
They actually went and changed the text! That is quite typically Disney, for better or for worse. The original text is luckily preserved at the Internet Archive:
https://web.archive.org/web/20220724134011/https://studios.d...
So if they did/do actually ask only the male actors, it should probably say that. If they're asked only based on the characteristics of their facial hair, it could say that.