News for hackers. Stuff that matters.

A comment on /story/41057030.

Re: by tunesmith on Thursday July 25, 2024 @03:59PM (#41072720)
I think one of the hardest things about voice AI is being able to gracefully modulate between styles of input/output delay. In actual technical conversations sometimes it is appropriate to patiently wait for someone to ask a very difficult question with delays in speech, and sometimes it is appropriate to interrupt regularly and ask brief pointed questions that require one-word answers, and everywhere in between. I'm really looking forward to having that kind of interchange with an LLM.
[ Parent | on HN ]
Re: by za_mike157 on Thursday July 25, 2024 @04:06PM (#41072801)
you are 100% correct! Here we just check if there is a pause of 200ms (you can change that in the code). I haven't seen any models that can detect if the user has finish speaking base on the question or social cues. You also don't want to make the delay so long since then it sound unnatural
[ Parent | on HN ]
Re: by anvil-on-my-toe on Thursday July 25, 2024 @04:30PM (#41073040)
I wonder if you need to account for body language to get that figured out. A technical conversation on the phone is usually not as fluid as in-person.
[ Parent | on HN ]
Re: by euroderf on Friday July 26, 2024 @01:22AM (#41075965)
Maybe a variable-pressure PTT button for the user would be effective. Push harder or less hard depending on whether or not a word is on the tip of your tongue. The AI could appropriately interrupt or not.
[ Parent | on HN ]