"Please stop shouting at the whiteboard. It doesn't work that way. I need you to pick up one of the dry-erase markers and write your algorithm to invert a binary tree."
"What? Who codes with their hands? I need my assistant!"
You may be interested in the guy that did all his coding with voice for a while because he couldn't use his hands, and still uses it to this day about half of the time. https://www.youtube.com/watch?v=8SkdfdXWYaI
https://github.com/melling/ErgonomicNotes/blob/master/progra...
No one said that you have to do everything. Start with what's possible then iterate.
(btw, if anyone knows anything about software/hardware to do that? let me know)
It would good to have the options to voice or gesture command a desktop computer.
I created speech bindings for my most common navigation tasks:
- "Down" -> presses PgDn
- "Down a bit" -> presses "down" a few times
- "Switch" -> presses Cmd+Tab (next application)
- "Backtick" -> presses Cmd+` (next window)
- "Apple L" -> presses Cmd+L (focus address bar)
Latency was good enough. Bindings have a higher priority than dictation, so if it hears one of your custom bindings: it will immediately action it instead of waiting to hear a full sentence.
Mac version was mostly only reliable for triggering keyboard shortcuts. Dictation of sentences worked pretty well, but there were (many) significant bugs that meant it was not generally viable.
I eventually stopped because of one of the following (can't recall):
- OS updates broke it - lost the license in a computer switch - hands got better
Almost the identical use case - I sometimes sit back and use gestures to scroll, swipe browser back, swipe between desktops.
An external trackpad would also do the trick, but the mouse is ergonomically nice for when you're stretching or leaning back.
In the same vein, I am learning morse code. Any resources helping with this would be appreciated.
I would like to use morse code for silent, no-look I/O on my phone. I'm not sure vibrations can be quiet enough; might have to use something special-purpose plugged into the headphone jack.
Make the whole keyboard area a blank "tap zone" where you can just use any digit to tap text into an input field.
https://github.com/gitonwithit/MorseKeyboard
https://github.com/whymarrh/morse-code-keyboard
https://play.google.com/store/apps/details?id=com.Input.Mors...
Or my wife ready to kill me as I'm saying code while she's watching tv. :)
And, IMO, even mumbling would be better than the current open office constant flow of loud conversations (one of which I'm trying to drown out with headphones this very moment).
Oh, and it must work locally instead of sending everything to the cloud.
For now, it would be helpful to many if there were no such limitations. In other words, comments like "Make it even smarter and it can't go to the cloud then I might use it" can safely be ignored for now. There's a market for an MVP that does a lot less.
"Jarvis import library foo" - could be said from anywhere in file
"Jarvis jump to file bar.c"
"Jarvis declare var current temperature equals zero" - var currentTemperature = 0
"Jarvis write for enumeration on var word over var name list"
"Jarvis build and run" or simply "Jarvis run"
By the way, I know many people don't like to talk to a computer, can't imagine how it could be faster than typing, etc. However, I believe that once an assistant is done right, more than a few people would be converts.