News for hackers. Stuff that matters.
Re:Google “We Have No Moat, and Neither Does OpenAI” by int_19h on Thursday May 04, 2023 @04:27PM (#35821607)
This really ought to mention https://github.com/oobabooga/text-generation-webui, which was the first popular UI for LLaMA, and remains one for anyone who runs it on GPU. It is also where GPTQ 4-bit quantization was first enabled in a LLaMA-based chatbot; llama.cpp picked it up later.

There are no comments on this comment yet.