Before you can touch it, you have to see it. (Or if it's just a glorified controller with hard-coded buttons, it's a very expensive controller with poor use characteristics.) Touching it is even slower. I think there's a lot more friction than anybody is seeing in their pretty-happy mental visualizations unencumbered by experience.
I do, however, agree with your skepticism -- I don't think it will be used to it's full (or proper) effect. Business concerns and the failure of imagination on the part of game developers will probably relegate this extra control mechanism to same fate as wiggle-attacks.