It's not perfect, Valves new controller prototype is probably the closest we have to noninteusive, low latency gesture tracking with some form of feedback (the oculus Half moon prototypes were also fairly close, but iirc the gesture recognitation was neutred for what ever reason).

http://www.roadtovr.com/wp-content/uploads/2016/10/valve-vr-...