News for hackers. Stuff that matters.
Re:NanoGPT by Metus on Wednesday January 11, 2023 @08:42AM (#34338287)
I find OpenAI having exclusive access to that kind of high-quality data more concerning than them having access to their current amount of compute and currently trained model. A couple of million dollars worth of compute is in the realm of any medium sized research university, larger company or any country worth of mention. And seeing as Moore's law still applies to GPU, the cost will only fall.

However high-quality data is scarce. I would be willing to fund a proper effort to create high-quality data.

There are no comments on this comment yet.