Ichigo: Local real-time voice AI

Re:Ichigo: Local real-time voice AI by lostmsu on Thursday October 17, 2024 @05:54PM (#41874204)

I understand that. The problem is that in many scenarios users would want to see transcripts of what they said alongside the model output. Like if I have a chat with a model about choosing a place to move to, I would probably also want to review it later. And when I review it, I will see: me: /audio record/ AI: 200-300m. No easy way to see at glance what the AI answer was about.

[ Parent | on HN ]

Re:Ichigo: Local real-time voice AI by readyplayeremma on Friday October 18, 2024 @07:21AM (#41878333)

You can just run whisper on the conversations as a background job populating the text versions of all the user inputs, so it doesn't interfere with the real-time latency.

[ Parent | on HN ]

Re:Ichigo: Local real-time voice AI by lostmsu on Friday October 18, 2024 @10:32AM (#41879825)

It's not going to match what model hears.

[ Parent | on HN ]