News for hackers. Stuff that matters.
Re:The RWKV language model: An RNN with the advantages of a ... by michannne on Thursday March 30, 2023 @11:35AM (#35374391)
Seconding this.

Llama 30B 4-bit has amazing performance, comparable to GPT-3 quality for my search and novel generating use-cases, and fits on a single 3090. In tandem with 3rd party applications such as Llama Index and the Alpaca LoRa, GPT-3 (and potentially GPT-4) has already been democratized in my eyes.

There are no comments on this comment yet.