News for hackers. Stuff that matters.

A comment on Quantized Llama models with increased speed and a reduced memory footprint. Parent comment

Re:Quantized Llama models with increased speed and a reduced... by Arcuru on Thursday October 24, 2024 @05:00PM (#41939702)
I access them by running the models in Ollama (on my own hardware), and then using my app Chaz[1] to access it through my normal Matrix client.

[1] - https://github.com/arcuru/chaz

[ Parent | on HN ]

There are no comments on this comment yet.