News for hackers. Stuff that matters.
Re:Quantized Llama models with increased speed and a reduced... by drilbo on Thursday October 24, 2024 @06:28PM (#41940483)
https://github.com/a-ghorbani/pocketpal-ai

This was just recently open sourced and is pretty nice. Only issue I've had is very minor UI stuff (on Android, sounds like it runs better on iOS from skimming comments)

There are no comments on this comment yet.