News for hackers. Stuff that matters.

danscarfe

But not in AR
Yes we demonstrated XRAI running on the Qualcomm Reference Wireless Viewer at MWC
We have true AR with 3D placement now on these glasses
The depth is set manually but can be changed at any point, even mid conversation
The light is bounced straight into your eyes using something called a birdbath lens
Unfortunately Apple users will have to wait for the Apple glasses which are being released some point after 2025/2026. The specific things the glasses use are HDMI over DisplayPort Alt Mode (USB-C) and Qualcomm chips in the phone.
We are soon releasing versions for iOS, Mac and Windows. We are also hoping to release an extensibility model to allow others to build skins / modules. The glasses will only work properly on Android though.
It does it segment by segment with autocorrect
It doesn't appear on the glasses. It appears in 3D space infront of you. It's almost impossible to show via video.
You can indeed. It's called the Nreal sdk
We support both!
The current generation of glasses (such as these Nreal Airs) use a birdbath technology which requires a tint. The next generation of waveguide glasses won't require this but they are currently not as good visual quality, especially for reading text. They are also a lot more money. Everything is a trade off right now. The next couple of years will be transformational.
You pin the captions next to the person. We did try speech bubbles, but it didn't look great, so we went back to simple subtitles.
You can see how it appears in our promo video: https://www.youtube.com/watch?v=iilN0368vQU
Compared to contemporary AR glasses ($2k+), these Nreal Airs are fairly cost effective at $379. We plan to support lots more glasses as they come out, especially ones with waveguide technology that doesn't require the shared lenses.
We've taken a privacy-first approach here. All data is only ever stored on the device, owned by the user, inaccessible to us. It's only ever transcribing when a user asks it to and only stored if the user asks it to be. We don't censor anything. We are soon to release purely on-device transcription, but the quality of this is still not as good as the cloud providers offer. The app itself is what powers the glasses, they are just output devices.
The advantage of using AR glasses is you can still look at the person, see their facial expressions, the reactions etc without always having to look down at your phone. The glasses aren't very bulky or heavy. We're just providing an option for those that want it. It's a magical experience :)
Thanks for the shout-out! To try and answer your questions:

1) The cocktail party problem is still a WIP. This is a very hard problem to solve.

2) These are not 'viewer' glasses they are 3DOF glasses which support moving and pinning the subtitles in 3D space

3) Whilst we targeted the Deaf and HOF to begin, we see broad applicability beyond this

4) You don't need glasses to test it, just an Android 12+ phone. Download and try it. We'd love your feedback https://link.xrai.glass/app