News for hackers. Stuff that matters.

A comment on Fifteen Times Faster Than Llama 2: Introducing DeciLM LLM with Variable GQA. Parent comment

Re:Fifteen Times Faster Than Llama 2: Introducing DeciLM LLM... by nickpsecurity on Friday September 15, 2023 @10:18PM (#37531389)
Best one I know for local AI's is below. The people who make the quantizations and OSS software often post there. You can find a lot on models, building rigs, etc using search.

https://www.reddit.com/r/localLLaMA/

[ Parent | on HN ]

There are no comments on this comment yet.