I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by brittlewis12 on Monday January 08, 2024 @08:10PM (#38920933)

I’m very sorry to hear you had such a poor experience as well. I’m sure it’s little consolation at this point having been inconvenienced as you have — it’s certainly not what I aim for in my work!

I’ve just submitted a new update for review with a number of small but material changes to address these issues: https://news.ycombinator.com/item?id=38920916

I hope you’ll consider giving it another shot once that’s live, and thank you for taking the time not just to test but also to report your experience!

Britt

[ Parent | on HN ]

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by urbandw311er on Tuesday January 09, 2024 @01:39PM (#38930056)

Thanks. I did test your new version but unfortunately similar issues. App completely hung and entire OS was sluggish. iPhone 13 Pro, iOS 17.1.2. Unfortunately I won’t have time to test any more but very good luck with the project.

[ Parent | on HN ]