News for hackers. Stuff that matters.

A comment on Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa. Parent comment

Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by 2bitencryption on Tuesday March 28, 2023 @09:19PM (#35350745)
It's $0.590/hr to rent an A6000 48GB gpu on jarvislabs.ai, which you can do right now, and run the 30b (or 65b with some hard work) model and get incredible results. No confidentiality agreement required :)
[ Parent | on HN ]
Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by Casteil on Tuesday March 28, 2023 @09:55PM (#35351100)
Do you know how their "spot pricing" works, exactly? "lets you use spare GPUs" doesn't tell us much. Is it granular to how long the duration the model is actively processing your prompt? ..or do you get dinged for an hour immediately and again on the hour?
[ Parent | on HN ]