News for hackers. Stuff that matters.
Re:Llama3 running locally on iPhone 15 Pro by iAkashPaul on Tuesday April 23, 2024 @09:00AM (#40131470)
You can either modify the Android example inside llama.cpp or my fork of it at GitHub.com/iakashpaul/portal

Increase the Ctx to more than 100 & link to any Q4 GGUF of 7B

There are no comments on this comment yet.