News for hackers. Stuff that matters.
Re:Falcon 40B LLM (which beats Llama) now Apache 2.0 by amstan on Friday June 02, 2023 @03:13AM (#36162071)
I've been running vicunda-13B on a workstation that can be aquired from ebay for about $500. It's slow compared to online services, but probably slightly faster than text to speech would recite its output, so plenty.

Falcon 40B is probably too much for it, but apparently there's similar cheap hardware that could work.

There are no comments on this comment yet.