https://hackaday.com/2020/04/15/the-smallest-large-display-i...
I think it would be quite fun to have a HUD like that for daily life.
https://www.reddit.com/r/AR_MR_XR/comments/javtb8/remember_t...
Presumably the university eventually sold the patents off and they're sitting in some dusty corporate vault now, but maybe they'll expire soon.
Obviously a full color display that could overlay reality at will with a wide FoV would be better, but I think the monochrome vector laser thing is achievable today and for me personally would be invaluable.
If you completely obscure one eye's vision that no longer works and you've lost your depth perception.
Even having one eye blurry is sufficient for parallax to work. (I have very different prescriptions for each eye and if I take my glasses off I can still do distance vision even though one eye can't read any text further away than about 2 feet)
So try it - put an eye patch on for a day and see how many door frames you walk into... or the headache you may get trying to use focusing an eye at different distances (and that's fairly tiring for the lens muscle to be doing all day if it isn't properly exercised).
The "Open source platform" part of the slideshow shows object detection at various distances. If it can box a car 20 feet away, a building 400 yards away, near objects on my breakfast plate, etc., then the plane of projection has to vary over a huge range as you look around (?). In general many of the demos I see seem to have remarkable things going on, in terms of what parts of the UI and world are in focus simultaneously.
While I'm making up some numbers... the sensor for that camera is 3.6mm x 2.7mm. A 5mm lens (that's a made up number) at f/3.5 (that's a guess) would have everything from 5 feet away to infinity be in acceptable focus. If it's a 3mm lens (again, made up number), then everything from 2 feet to infinity is in acceptable focus.
So having the stuff on your plate and the building in the distance both be in focus - yea, that's something reasonable.
But I am still interested in the overlay and how distracting that actually becomes.
So by plane of projection I mean the apparent distance of the virtual image of the UI. If your eyes are focused "through" the display on something a few yards away vs. relatively close, the light from the UI needs to come into your eye (or possibly glasses etc.) as though it is tracing rays in parallel from roughly the same distance away.
Quake style consoles and other HUDs work in video games because in reality the entire scene is coming from the plane of the display, some inches in front of you. If you tried to really focus on a game object 20 yards away, instead of on the screen in front of you, the HUD wouldn't be visible anymore.
In VR optics I believe the virtual screen is something like ~6 feet out in front of you. It is a compromise and still causes eye strain, but is workable perceptually. The issues for transparent AR seem much more complex.
Many of the far-out concepts and ideas that are mocked up for AR seem actually very achievable right now, or yesterday, if the display works like a phone or laptop or VR goggle's does, by re-projecting camera input from a plane a few (possibly virtual) inches or yards away from your eye. The value added though is pretty niche, because people have mobile phones anyway. But if the iPhone hadn't happened, a little display in front of the eye, a whole visor, or a pop-up wrist computer might have been possible to sell. It sounds kind of silly now, but that's what the expectation was in the 80s-90s. The idea of putting a computer on your head still seemed cool then.
I have been seriously considering building a keyboard along these lines for in person meetings, so I can essentially have it on the table in front of me and take notes without a display.
You might enjoy Ben Valack's videos on the topic (18 key keyboard)
I, like many of you, am very good at telling a computer what to do with letters and symbols. I spend a lot of time in voice calls and I often write little scripts while I'm talking to answer questions, ballpark numbers etc. That's not to mention the power of tools like Wolfram Alpha and Google.
I would like that to be everpresent in my life. I know we'll get some semblance of this with conversational AI at some point soon, but for me I crave the determinism of real programming. I want to be able to summon a quake-style REPL from the sky at will, and while looking someone face to face google facts or compute probabilities. I want to be able to sketch algorithms while walking around in nature.
(Intel was working on something like this at one point but sadly the project was abandoned)