> I would really like to see something like a vr-based hand gesture based midi app: wave arms like symphony conductor, put some colorful shapes in 3d space to anchor movement/provide visual feedback, etc.
I love this - hopefully we will see it built some day!
GlovePIE if I’m not mistaken lets you use a wiimote as a midi controller
TidalCycles/Supercollider lets you emit midi from haskell, there are also other libraries in other languages (rtmidi in c++? and plenty in python, also there’s the web midi api in browsers)
I once tried a project with a flight simulator joystick as an input, it was just ok though lol
pen2bow: use the apple pencil like a violin bow midi control
I also once saw a research project that used muscle-activity sensors applied externally to the throat to do /non/-acoustic pitch detection/midi control; it would tell which pitch you would be able to emit just by the posture of your vocal tract. In general I think myography seems like a cool bridge between the body and signals
I would really like to see something like a vr-based hand gesture based midi app: wave arms like symphony conductor, put some colorful shapes in 3d space to anchor movement/provide visual feedback, etc.