Re:I made an app that runs Mistral 7B 0.2 LLM locally on iPh...
by livrem on Monday January 08, 2024 @04:09AM
(#38909699)
That is exactly how I ran llama on my old Android phones a few days ago. Did not even know there was documentation for it. It just worked to compile and run like on desktop. How would having an app be better? Running it in termux means I can use git to sync the wrapper-scripts and chat-templates that I have on my desktop computers to also run on the phone (but using a smaller model).
[ Parent
| on HN ]
There are no comments on this comment yet.