News for hackers. Stuff that matters.
Re:Google tells staff it plans to limit publishing AI research by segmondy on Friday May 05, 2023 @09:39AM (#35829057)
So the lesson they could only take from their failings is to limit publishing instead of capitalizing on new techs? Almost every if not all authors of "Attention is all you need" left Google before ChatGPT broke the world. If the paper was internal I suspect they would have probably left even earlier, taken their ideas elsewhere and still beaten Google to it. If everyone stayed hush hush, Google might not even know what gave other's an edge. There's no secret to AI as we know it today, deep learning, RL, transformers, LOTS and LOTS of data, plus lots and lots of training.
Re:Google tells staff it plans to limit publishing AI research by neel8986 on Friday May 05, 2023 @09:44AM (#35829098)
This is ending soon. Even according to sam altman from ai we have reached a limit on large model. We need new techniques like attention, transformer, layernorms