News for hackers. Stuff that matters.

A comment on Show HN: Open-source macOS AI copilot (using vision and voice).

Re:Show HN: Open-source macOS AI copilot (using vision and v... by jondwillis on Tuesday December 12, 2023 @10:01AM (#38613010)
You should add an option for streaming text as the response instead of TTS. And also maybe text in place of the voice command as well. I have been tire-kicking a similar kind of copilot for awhile, hit me up on discord @jonwilldoit
[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Tuesday December 12, 2023 @10:12AM (#38613185)
There's definitely some improvements to shuttling the data between interface<->API, all that was done in a few hours on day 1 and there's a few things I decided to fix later.

I prefer speaking over typing, and I sit alone, so probably won't add a text input anytime soon. But I'll hit you up on Discord in a bit and share notes.

[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by jondwillis on Tuesday December 12, 2023 @10:39AM (#38613569)
Yeah, just some features I could see adding value and not being too hard to implement :)
[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by tomComb on Tuesday December 12, 2023 @10:35AM (#38613516)
> text in place of the voice command as well

That would be great for people with Mac mini who don't have a mic.

[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Tuesday December 12, 2023 @12:46PM (#38615627)
Hmmm... what if I added functionality that uses the webcam to read your lips?

Just kidding. Text seem to be the most requested addition, and it wasn't on my own list :) Will see if I add it, should be fairly easy to make it configurable and render a text input window with a button instead of triggering the microphone.

Won't make any promises, but might do it.

[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by danaris on Tuesday December 12, 2023 @08:17PM (#38621373)
People with a Mac mini may not have a webcam, either!
[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Thursday December 21, 2023 @01:03PM (#38724095)
It was a joke.
[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Thursday December 21, 2023 @01:04PM (#38724103)
Added text input instead of voice as an option today.
[ Parent | on HN ]