News for hackers. Stuff that matters.
Re:OpenAI is too cheap to beat by zarzavat on Thursday October 12, 2023 @04:50PM (#37862999)
It’s a different situation computationally. Transformers are asymmetric: hard to train but easy to run.

There is no such thing as an open source Google because Google’s value is in its vast data centers. Search is hard to train and hard to run.

GPT4 is not that big. It’s about 220B parameters, if you believe geohot, or perhaps more if you don’t.

One hard drive.

There are no comments on this comment yet.