News for hackers. Stuff that matters.
Re:Handsfree.js – integrate face, hand, and/or pose tracking... by twobitshifter on Saturday June 05, 2021 @09:50AM (#27405007)
What are some of the applications for this?
Re:Handsfree.js – integrate face, hand, and/or pose tracking... by blensor on Saturday June 05, 2021 @05:17PM (#27408521)
I can't speak about this specific project but pose tracking in the browser can actually be really useful to get it on mobile without the need for dedicated apps.

We are currently experimenting with using phones (or tablets or basically anything with a browser and a camera) as a tracking source for full body tracking on the Oculus Quest ([1]) and being able to just use a Tensorflow model in the browser has cut down the time of development on the mobile device side to almost nothing.

There are of course a whole lot of other issues one buys into with that approach (browser security policies, the whole thing not working in certain countries due to problems with loading the model) but that's manageable

[1] https://www.youtube.com/watch?v=zz9S5hgrWpM (relevant part starts at 0:29)

Re:Handsfree.js – integrate face, hand, and/or pose tracking... by danielskogly on Saturday June 05, 2021 @12:13PM (#27406242)
I found this demo of him playing "Into the Breach" with only Face Gestures very impressive! https://twitter.com/GoingHandsfree/status/140022171083874713...
Re:Handsfree.js – integrate face, hand, and/or pose tracking... by tppiotrowski on Saturday June 05, 2021 @08:59PM (#27409758)
I made a slouching detector a while back. It calibrated the distance of your face from your laptop and if you start leaning in it’ll give you a notification to sit back. It’s a bit dated but still works on Chrome and FF, I believe:

https://slouchcam.com

Re:Handsfree.js – integrate face, hand, and/or pose tracking... by Gys on Saturday June 05, 2021 @10:36AM (#27405401)
Re:Handsfree.js – integrate face, hand, and/or pose tracking... by umvi on Saturday June 05, 2021 @03:40PM (#27407929)
You could integrate this with adtech to help make advertisements more interactive and to analyze how the viewer is receiving the ad by their pose and facial expressions. Based on that you could have an algorithm serve only ads that improve facial expressions and poses to positive ones
Re:Handsfree.js – integrate face, hand, and/or pose tracking... by lolinder on Saturday June 05, 2021 @05:25PM (#27408573)
I hope we haven't yet gotten to the point where people will mindlessly click "Yes!" when a random website asks for webcam access.
Re:Handsfree.js – integrate face, hand, and/or pose tracking... by Solocomplex on Saturday June 05, 2021 @03:45PM (#27407965)
Another excellent reason to disable JavaScript in your browser
Re:Handsfree.js – integrate face, hand, and/or pose tracking... by jcdietrich on Saturday June 05, 2021 @03:48PM (#27407981)
Could play punch the monkey!
Re:Handsfree.js – integrate face, hand, and/or pose tracking... by notjustanymike on Saturday June 05, 2021 @04:50PM (#27408355)
WebXR comes to mind.