News for hackers. Stuff that matters.

A comment on OpenAI closes its monster $10B funding round at $27B-29B valuation. Parent comment

Re:OpenAI closes its monster $10B funding round at $27B-29B ... by fafqg on Saturday April 29, 2023 @05:34AM (#35751461)
You could say the same about many SaaS projects. Why pay for an expensive GPU upfront and then some guy who can install it, configure it, create some sort of interface for you to talk to it... when you can just pay openai to do it for less money?
[ Parent | on HN ]
Re:OpenAI closes its monster $10B funding round at $27B-29B ... by jimkoen on Saturday April 29, 2023 @09:48AM (#35752832)
Because GPU-Servers that can run a typical LLM are less than 5k, which includes installation. Really, running an LLM seems to be no more complicated than running a NAS from a system administrators perspective.

Emphasis on running, not training.

[ Parent | on HN ]
Re:OpenAI closes its monster $10B funding round at $27B-29B ... by MichaelZuo on Monday May 01, 2023 @02:49PM (#35777330)
5k can't even get you 80 GB of VRAM on a GPU. How is that possible?
[ Parent | on HN ]