News for hackers. Stuff that matters.
Re:Show HN: Open-source macOS AI copilot (using vision and v... by smcleod on Tuesday December 12, 2023 @04:54PM (#38619198)
Nice project, any plans to make it work with local LLMs rather than "open"AI?
Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Tuesday December 12, 2023 @05:23PM (#38619547)
Thanks. Had no plans, but might give it a try at some point. For me, personally, using OpenAI for this isn't an issue.
Re:Show HN: Open-source macOS AI copilot (using vision and v... by hmottestad on Tuesday December 12, 2023 @05:26PM (#38619572)
I think that LM Studio has an OpenAI "compliant" API, so if there is something similar that supports vision+text then it would be easy enough to make the base URL configurable and then point it to localhost.

Do you know of a simple setup that I can run locally with support for both images and text?