News for hackers. Stuff that matters.

A comment on I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros. Parent comment

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by ionwake on Sunday January 07, 2024 @09:13PM (#38907505)
Amazing! Does it submit any data online ?
[ Parent | on HN ]
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by wahnfrieden on Sunday January 07, 2024 @10:04PM (#38907771)
No.

I definitely do not want any liability of user-generated content or PII or similar. I have no analytics, besides the standard Apple opt-in crash/reporting (not using any 3rd-party service and not sending anything to my own servers).

It downloads configuration from GitHub and HuggingFace directly. It also has OpenAI integration, directly to their servers via BYOK.

[ Parent | on HN ]