News for hackers. Stuff that matters.
Re:OpenAI’s CEO Says the Age of Giant AI Models Is Already Over by bitL on Monday April 17, 2023 @05:14PM (#35606677)
Transformers were known that they kept scaling up with more parameters and more training data so if the Open AI hit the limits of this scaling that would be a very important milestone in AI.
Re:OpenAI’s CEO Says the Age of Giant AI Models Is Already Over by fastball on Tuesday April 18, 2023 @12:37AM (#35610005)
I think performance will keep scaling, the main problem is cost. If you want to feed longer strings of tokens in, the price is going to keep going up.