Very neat idea. Kung Fu + AI + Vision Computing. There might be a chance that it could be played only with a PC and a Webcam, like the flash game Motion Bubbles, I guess.