Re:ChatGPT can now see, hear, and speak – openai.com
by nomel on Monday September 25, 2023 @03:50PM
(#37649601)
Related, the iOS app has supported realtime conversations for months now, using Shortcuts app and the "Hey Siri <shortcut name>" trigger to initiate it. Mine is "Hey Siri, let's talk".
I think they're using Siri for dictation, though. Using Whisper, especially if they use speaker identification, is going to be great. But, a shortcut will still be required to get it going.
I think this could bring back Google Glass, actually. Imagine wearing them while cooking, and having ChatGPT give you active recipe instructions as well as real-time feedback. I could see that within the next 1-3 years.