I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by ngai_aku on Monday January 08, 2024 @03:45PM (#38917843)

I was excited when I saw this, but I'm having trouble with it (and it looks like I'm not the only one). As others have pointed out, the download link on your site does open TestFlight. I've since deleted that version and installed the official version from the AppStore after revisiting this thread in search of answers.

I now have the full version installed on my iPhone 15 pro, and I have added my OpenAI key, but none of the models I've selected (3.5 Turbo, 4, 4 Turbo) work. My messages in the chat have a red exclamation next to them which opens an error message stating 'Load failed' when clicked. If I click 'Retry Message' the entire app crashes.

[ Parent | on HN ]

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by wahnfrieden on Monday January 08, 2024 @04:32PM (#38918475)

Apologies for the rough edges and bad experience - I’ve just soft launched without announcement til this post. I will have a hotfix up soon. Thanks for the report.

[ Parent | on HN ]

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by ngai_aku on Monday January 08, 2024 @06:26PM (#38919963)

No stress. Best of luck!

[ Parent | on HN ]