News for hackers. Stuff that matters.

A comment on Talk-Llama. Parent comment

Re:Talk-Llama by oceanplexian on Thursday November 02, 2023 @12:27PM (#38115965)
Depends on what you mean by "best"? Absolute bleeding edge fastest possible inference? ExLlama or ExLlamaV2 on a 4090.
[ Parent | on HN ]

There are no comments on this comment yet.