Re:Handtrack.js: A library for prototyping realtime hand det...
by po1nter on Sunday January 03, 2021 @06:59AM
(#25621280)
It detects my face as a hand with a score of 0.900+ especially when I tilt my head backwards.
[ Parent
| on HN ]
Re:Handtrack.js: A library for prototyping realtime hand det...
by bathtub365 on Sunday January 03, 2021 @11:03AM
(#25622504)
How is something like this addressed in ML? In traditional software development there are tools like automated tests & static analysis to prevent your customers running into these types of embarrassing issues.
Re:Handtrack.js: A library for prototyping realtime hand det...
by vykthur on Sunday January 03, 2021 @11:23AM
(#25622680)
Author here, this is a known issue and being worked on for handtrack.js 2.0.
The face/head errors is likely an artifact of transfer learning (handtrackjs is finetuned on the object detection model trained using the coco object detection dataset which contains a person category).
Current approach being explored to expand the training data to include faces/heads such that the model better discriminates this from hands.
There are also size and speed optimizations being explored (smaller models such as efficientdet, quantization).