News for hackers. Stuff that matters.
Re:OpenAI is too cheap to beat by charlesischuck on Thursday October 12, 2023 @03:46PM (#37862203)
A top end gpu now to make you competitive cost 20-50k per gpu.

To train a top model you need hundreds of them in a very advanced datacenter.

You can't just plug gpus into standard systems and train, everything is custom.

The technical talent required for these systems is rare to say the least. The technical talent to make a model is also rare.

I trained a few foundation models with images, and I would NEVER buy any of them. These guys are on a wildly different scale than basically everyone.

There are no comments on this comment yet.