> Periodic writing with pencil tool

Very very inconvenient. Writing on air is completely different and considerably more tricky that writing on paper. Physically more demanding too. It's one of those things that sound nice in theory, but not really practical.

Actually this has problem has been solved and is used daily by millions of deaf people for decades... http://en.wikipedia.org/wiki/American_Sign_Language

Yup. ASL uses a pretty large amount of space and it's not clear to me that this thing can resolve every gesture. For instance, what happens when one hand occludes another from the Leap's perspective? Can it know that my thumb is up if the rest of my hand is hiding it?

But we can imagine a kind of ASL shorthand, like the original Palm Pilot's 'Graffiti'. Or, maybe if you buy two or three, you can set them up to combine perspectives, giving them more insight into the full 3d space.

That could be useful to deaf people and maybe could also serve as a new form of shorthand for people who are writing long texts on devices without keyboards.

From the "About" page:

You can even network more than one Leap device, to create even larger interaction areas.

I imagine two units orthogonal to each other might be enough to capture ASL.

Writing in air is flashier for press videos, but we understand this bit well. We can track your pen as you write on normal paper too. We'll post a video of this sometime shortly.

-Chris

You're right. I just tried it (not with the leap hardware) - the inability to "lift up" off the paper without leaving the sensor zone is weird. No haptic feedback when you're on the "paper" and not.

How about writing in the large - I am thinking big movements, like when writing on a marker board?

Still need to lift the marker to separate the words. And to touch it back rather precisely so not to have the next word to be an inch below the first one.

ain't feedback a relic of all 'press-double-hard-to-be-sure' buttons? With handwriting recognition it shouldn't be that hard. also, http://madebymany.com/blog/wizards-and-haptic-gestures

A Bluetooth 'dumb' stylus with a button or slide sensor could give a pretty convincing airbrush effect in a paint app.

I don't see traditional writing being a realistic application, though perhaps cursive signatures could work.

It hasn't been demoed but if you put the device on its side it allows you to write on the table (or paper) with the same result.

I disagree with you on the details a bit, but I think viewing this as good at somethings and bad at others is far more constructive than arguing that this should replace a mouse, keyboard etc.

However, I would make the good/bad list a bit more general: * good for manipulating UI elements that represent 3D * bad for manipulating UI elements that represent 2D

Maps and camera interactions (CAD) are perfect examples of things that represent 3D elements. Short games are another area that can represent 3D - longer games might also work well, but the user is likely to get tired of waving his/her arms around.

Much of what we do on computers today is strictly 2D. Coding, word processing, most web browsing, email, etc. Pencil tools/drawing tools are similarly usually just a 2D activity, so using a 3D-capable tool and reducing your movements to 2D doesn't really make sense.

I'm not sure how they're handling variance in user perspective, but assuming they've got that figured out, if you were to couple this with a stereo vision setup and some form of haptic feedback a lot of companies doing 3D design (both CAD and 3D artwork) would eat this up. It won't replace a keyboard and mouse, but it would provide a much more "immersive" way of interacting with the media.

One of the things I've dreamed of using gestures for is controlling behavior (scrolling, navigation, etc.) in a second monitor without changing focus. I hope somebody implements that.