News for hackers. Stuff that matters.
Re:AI hype is built on high test scores. Those tests are flawed by tuatoru on Tuesday October 10, 2023 @10:44PM (#37840314)
> Most of the improvements apparently come from training larger models with more data.

OpenAI is reportedly losing 4 cents per query. With a thousandfold increase in model size, and assuming linear scale in cost, that's a problem. Training time is going to go up too. Moore's law isn't going to help any more. Algorithmic improvements may help...if any significant ones can be found.

There are no comments on this comment yet.