Re:Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speec...
by WhitneyLand on Thursday March 05, 2026 @09:30AM
(#47261907)
Yes. Is there a basic chat app for iOS that prioritizes full intelligence over full duplex?
Agree ChatGpt advanced voice mode is so bad for quality of the actual responses. Old model, no reasoning, little tool use.
I just want hands free conversations with SOTA models and don’t care if I have to wait a couple of seconds for a reply.
Re:Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speec...
by dahcryn on Thursday March 05, 2026 @09:54AM
(#47262219)
I saw a demo of parloa (or maybe it was a different provider), and no joke, they insert sound of typing on a keyboard or stuff like that during an LLM tool call, its weird but surprisingly effective lol
Re:Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speec...
by satvikpendem on Thursday March 05, 2026 @09:26AM
(#47261862)
Why can't a speech to speech model do tool calls? Others like Gemini live do it just fine.
Re:Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speec...
by d4rkp4ttern on Thursday March 05, 2026 @09:47AM
(#47262113)
Ok, I was wrong. I just tested ChatGPT voice, Claude Voice and Gemini Live. And all three are able to do web search. For some reason, I thought when I tested ChatGPT voice a few weeks ago, it sometimes said it can’t directly open links, but it can do web search, which was strange.
Re:Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speec...
by raw_anon_1111 on Thursday March 05, 2026 @09:54AM
(#47262224)
If it is doing a tool call, it has to convert the speech to text or at least a JSON object of the necessary parameters for the tool and convert the result to speech doesn’t it? Is it truly speech to speech then?
Re:Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speec...
by satvikpendem on Thursday March 05, 2026 @10:16AM
(#47262522)
It's all tokens at the end of the day, not really text or video or audio, just like everything on a machine is just bits of 1s and 0s and it's up to the program to interpret them as a certain file format. These models are more speech-to-speech (+ text) in that they can recognize text tokens too. So the flow is, you ask it something, then,
Audio Tokens: "Let me check that for you..." (Sent to the speaker)
Special Token: [CALL_TOOL: get_weather]
Text Tokens: {"location": "Seattle, WA"}
Special Token: [STOP]
The orchestrator of the model catches the CALL_TOOL and then calls the tool, then injects this into the context of the audio model which then generates new tokens based on that.
Re:Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speec...
by water-drummer on Thursday March 05, 2026 @09:05AM
(#47261682)
Gemini live api and grok voice api can make tool calls and they're speech to speech models
Re:Nvidia PersonaPlex 7B on Apple Silicon: Full-Duplex Speec...
by d4rkp4ttern on Thursday March 05, 2026 @09:50AM
(#47262168)
Right, turns out Claude and ChatGPT voice can also do web-search. So I guess behind the scenes there is more than a "pure" voice-voice model being used, i.e. there's probably a rudimentary agent loop with tools + tool-exec interposed.
There are probably definitely use cases for this though, open to be educated on those.