News for hackers. Stuff that matters.
Re:Ask HN: Is OpenAI going to be the biggest company of all ... by briHass on Wednesday March 15, 2023 @04:23PM (#35174221)
How do you define 'small amount of capital'? Assuming you have to buy the processing from one of the big 3 (likely not possible to own the hardware outright), you're looking at 10s of millions of dollars per training run.

It's certainly not outside reality for the well-known software companies to have divisions working on it, but I don't think we're quite at the point where garage startups can afford the compute.

Re:Ask HN: Is OpenAI going to be the biggest company of all ... by smoldesu on Wednesday March 15, 2023 @05:04PM (#35174697)
> likely not possible to own the hardware outright

Why not? The majority of these models are running on fairly ubiquitous datacenter GPUs. They're being trained on highly available hardware. You're right that there's a compute barrier, but you get around that by throwing money at the problem. If someone was sufficiently motivated, they could probably dethrone OpenAI in 2 months with enough funding.

Re:Ask HN: Is OpenAI going to be the biggest company of all ... by jonnyreiss on Thursday March 16, 2023 @12:26PM (#35184200)
> If someone was sufficiently motivated, they could probably dethrone OpenAI in 2 months with enough funding.

I'd argue Google is sufficiently motivated to dethrone OpenAI --- so why haven't they? They have plenty of money to throw at the problem as well.