News for hackers. Stuff that matters.

A comment on Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa. Parent comment

Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by pmoriarty on Wednesday March 29, 2023 @03:08AM (#35353687)
"Buying a "high end GPU" isn't buying a 4090 or even two, it's 250k on a DGX unit and putting it in a datacentre. You will probably be able to find a service that would sign a confidentiality agreement and provide you with this service for less than 250k."

Does anyone have a projection based on historical GPU cost reductions as to how long we have to wait until a DGX unit costs as little as a 4090 does today?

[ Parent | on HN ]
Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by phh on Wednesday March 29, 2023 @07:04AM (#35355403)
The issue is largely around available RAM capacity, and sadly RAM price have barely decreased in the last 5-10 years
[ Parent | on HN ]