Browse the web Hands Free (Chrome extension)
http://www.handsfreechrome.com/
This is the initial release. While it's not perfect, it works pretty damn well. I'm hoping this will be transformative for people with injured/missing hands or disorders and conditions such as Parkinson's or severe essential tremor.For the rest of us, it's just fun. Once you get used to it, it's very comfortable as opposed to using a mouse/keyboard.
The main problem relates to the "map" command, which you'll quickly learn about once you try it out. It's a tricky problem, painting numbers next to all the clickable, visible items. What's clickable? What's visible? It's especially hard because some of the most popular pages (gmail, facebook) don't use standard input elements but rather heavily JS'ed divs that act like inputs.
(I know the website looks like it's from the 90s. Spare me.)
(
12 comments
| 34 points
| on HN
)
The main issue relates to the map command, which you'll quickly discover if you try the extension out.
How do you tell which elements on a page are clickable? How do you tell which elements on a page are truly visible? It's a bit tricky. Right now I default to buttons, inputs, anchors, spans, lis, textareas, and one or two others, and check for display:none, visibility:hidden, hidden parent elements, opacity:0, and overlapping positions, and maybe something else.
But it's especially hard with major websites like gmail and facebook that use heavily JS'ed divs instead of inputs. Still haven't found a solid solution to that one.
Apple should include OpenEars as part of iOS to have an advantage for all iOS 8 apps
How can you eat and utter voice commands at the same time?