Re:Falcon 40B LLM (which beats Llama) now Apache 2.0
by amstan on Friday June 02, 2023 @03:13AM
(#36162071)
I've been running vicunda-13B on a workstation that can be aquired from ebay for about $500. It's slow compared to online services, but probably slightly faster than text to speech would recite its output, so plenty.
Falcon 40B is probably too much for it, but apparently there's similar cheap hardware that could work.
Falcon 40B is probably too much for it, but apparently there's similar cheap hardware that could work.