News for hackers. Stuff that matters.

A comment on I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros. Parent comment

Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by coder543 on Monday January 08, 2024 @12:23AM (#38908607)
4-bit StableLM and 2-bit 7B models do seem to be working more consistently.
[ Parent | on HN ]
Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh... by brittlewis12 on Monday January 08, 2024 @01:07AM (#38908797)
That’s great to hear. I’m sorry again about that poor experience, and please do reach out if you have any other feedback!

Britt

[ Parent | on HN ]