Re:OpenAI DevDay, Opening Keynote Livestream [video]
by modeless on Monday November 06, 2023 @04:28PM
(#38169274)
Yeah I expect the speech recognition is happening in the cloud. But that doesn't mean it necessarily has to be slow. You can stream audio with very low latency on most connections. The problem is what they do with the audio once it gets to the server. I suspect it would be far too expensive to dedicate a GPU to each customer so they need to run everything in batch mode which increases latency.
[ Parent
| on HN ]
There are no comments on this comment yet.