News for hackers. Stuff that matters.
Re:Ask HN: After ChatGPT, why are voice assistants still so ... by ftxbro on Tuesday September 19, 2023 @01:46PM (#37573493)
It's because speech to text, text to speech, and LLMs all have latency. They are working on it. There were rumors that Apple is spending a million dollars a day on its secret AI. Probably some form of it will go into Siri.

Edit: you can try the gpt4-enhanced Bing, it works pretty well with voice

Re:Ask HN: After ChatGPT, why are voice assistants still so ... by throwawayllaq on Tuesday September 19, 2023 @03:44PM (#37575362)
I expected TTS/STT to be a solved problem now with decades of work on it.

I can understand LLMs having greater latency but all flagship smartphones have inference accelerators these days.

A good response is just an API away, which Google Assistant already does I think (it doesn't give me an instantaneous answer ever).