News for hackers. Stuff that matters.
Re:Falcon 40B LLM (which beats Llama) now Apache 2.0 by esperent on Friday June 02, 2023 @01:57AM (#36161574)
I briefly looked at prices a few days ago, I think you can rent an 80gb GPU for about $2.50 an hour. Then you just pay while you're using it.

Someone else might be better able to confirm the pricing, but in any case you don't need to purchase the hardware.

Re:Falcon 40B LLM (which beats Llama) now Apache 2.0 by amstan on Friday June 02, 2023 @03:09AM (#36162042)
I'm less interested in using someone else's computer (not as much, but similar to how i'm disinterested in an API from someone like OpenAI), would rather pay the upfront hardware cost than worry about how many tokens i generate (kind of hinders creativity and excitment about it).