News for hackers. Stuff that matters.
Re:Show HN: I made an app to use local AI as daily driver by FloorEgg on Tuesday February 27, 2024 @08:44PM (#39532865)
Maybe this isn't for everyone, just the people who place a high value on privacy.
Re:Show HN: I made an app to use local AI as daily driver by ukuina on Tuesday February 27, 2024 @09:05PM (#39533027)
But how can I guarantee this app is private?

I'm assuming I cannot block internet access to the app because it needs to verify App Store entitlement.

Re:Show HN: I made an app to use local AI as daily driver by vunderba on Tuesday February 27, 2024 @11:36PM (#39534060)
If your ultimate goal is privacy, then you should only be looking at open source chat UI front ends:

https://github.com/mckaywrigley/chatbot-ui

https://github.com/oobabooga/text-generation-webui

https://github.com/mudler/LocalAI

And then connecting them to off-line models servers:

- Ollama

- llama.cpp

And you should avoid closed source frontends:

- Recurse

- LM Studio

And closed source models

- ChatGPT

- Gemini

Re:Show HN: I made an app to use local AI as daily driver by copperx on Wednesday February 28, 2024 @02:30AM (#39535074)
Are you implying Claude is an open source model?
Re:Show HN: I made an app to use local AI as daily driver by djfdat on Thursday February 29, 2024 @08:05PM (#39557303)
I don't think the list was meant to be exhaustive.
Re:Show HN: I made an app to use local AI as daily driver by giblfiz on Tuesday February 27, 2024 @09:25PM (#39533160)
I mean, ok, then how do you distinguish yourself from LM Studio (Free)