alex1115alex
The acceptance criteria made sense for our app (it displays your phone’s notifications on your smart glasses HUD, and users need a way of selecting which apps can/can’t display notifications). I don’t know how HSBC justifies it though.
https://github.com/Mentra-Community/MentraOS/tree/main/cloud
https://docs.mentra.glass/ubuntu-deployment
https://docs.mentra.glass/railway-deployment
In your opinion, what do you think should change to make this an "actual" open source OS?
We're also working on a pair of HUD glasses that will release in 2026 using an NRF5340 MCU. The code for this is being developed in the `mcu_client` folder.
https://github.com/Mentra-Community/MentraOS/tree/main/cloud
https://github.com/Mentra-Community/MentraOS/blob/main/glass...
We're also looking to support the Brilliant Labs Halo glasses once they release later this year.
Regarding Ray-Bans: We'd love to support those, but the Ray-Bans are extremely locked down. Nobody has found a jailbreak yet. We're always open to support more glasses provided they're all-day wearable and have an SDK.
Even Realities G1 are the best HUD glasses on the market right now. They’re the first pair (with prescription) that I can wear all-day without pain, and without looking like a dork.
My team used to main the Vuzix Z100 glasses, starting with the Vuzix Ultralite reference design that predated them. We won’t touch them these days (and recently stopped selling them on our store).
Others… Meizu StarV Air 2 and INMO GO2: both lack public SDK, GO2 is too heavy. Brilliant Labs Frame: cool prototyping toy, awful glasses.
For “AI glasses” that have camera, no display:
You have the RayBan and a number of companies making these. The only one I can recommend is our upcoming Mentra Live (https://mentra.glass). It has the same camera sensor as the RayBan, but runs open source software & has an SDK.
For more sci-fi glasses that run Android and have display + camera, see the INMO Air 3, TCL RayNeo X3. These are too heavy to be worn as regular glasses, but are fun prototyping tools.
All these companies will exist in 2026. As for a 5 year horizon, I’d place my bets on Even Realities, and Vuzix (as a waveguide supplier, not consumer HW). Meizu and TCL will stick around as Chinese megacorps, though I’m 50/50 they will continue developing consumer smart glasses. Brilliant Labs is cooked unless they turn things around with their next pair of glasses.
Google & Android XR: I don’t expect their glasses to be competitive for at least a few HW generations at minimum. In terms of public information, we know they’re monocular and heavy (>45g), which is an immediate killer for the majority of users.
Shameless plug: We build an open source OS for glasses that works with them. AugmentOS.org
They also patched the known jailbreak methods early this year, so all newer models lack sensor access unless you pay Unitree massive $$$ for SDK access.
The base Go2 is a fun toy, though. There’s a high level web SDK you can use for free.
The Nordic MCU they use isn't actually the limiting factor, rather it's the glasses' firmware. For bitmaps from third party apps (like AugmentOS), they enforce 194 byte chunk sizes and do not support RLE. Their first-party app does not have these limitations. We're stuck with this problem for the G1, but we're working with hardware partners to make sure future glasses don't have these issues.
For example, when a native speaker says something like:
"The manufacturing happens on 6th floor",
We'll know the words for
"The [unknown] happens on the 6th floor",
but not the word for "manufacturing".
Our strategy is to fill these gaps, and only these gaps. This way, we can learn uncommon words faster over time without having to rely on full-on translation as a crutch.
This is an inferior means of development, however.
By going through AugmentOS, you get a much easier development experience, compatibility with multiple pairs of glasses (through both iOS and Android), and the ability to run multiple glasses apps simultaneously.
I put sheet music into smart glasses [video]
https://www.youtube.com/watch?v=j36u2i7PKKE
https://github.com/kevinlinxc/AugmentedChords
Awesome job Kevin!
https://youtube.com/shorts/FthRCwn1JuM?si=lC3eWAUI7sV-LL-r
A wearable speech coach would be awesome, though. Detect filler words and give you an alert on your HUD when it detects "uh" "uhm" etc.
We're going to have to do insane things to get them working. Due to how ANCS works, we're considering developing an ANCS "doohicky" (either a BLE pop-socket, smart-ring, or mag-safe wallet) which gets notifications via BLE & relays them back to the iPhone, to then send to the glasses. That would just get us the raw notifications, though, and wouldn't solve the issue of replying. The other option is a Beeper-like system in the cloud to bypass iOS entirely, but that also has downsides.
It's a total mess, especially compared to Android where you can just easily listen for notifications & send them to the glasses without much pushback from the system.
Also, the developers are super active in their Discord and are fast to fix bugs. Love this project.
https://x.com/caydengineer/status/1889835639316807980
One thing I'm hoping for is an increase in speed. Right now, the agent is slow for complex tasks, so we're still in an era where it might be better to codify popular tasks (eg: sending a WhatsApp message) instead of handling them with browser automation. Have yall looked into Groq / Cerberus?