News for hackers. Stuff that matters.
Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by tempusalaria on Saturday October 28, 2023 @07:20AM (#38048931)
The likely architecture of GPT-4 was invented at Google - MoE. OpenAI poached the team who developed it.

OpenAI is ahead on the RL data side. To me that’s the likely biggest advantage they have in GPT-4.

Re:Google agrees to invest up to $2B in OpenAI rival Anthropic by danenania on Saturday October 28, 2023 @10:55PM (#38055491)
Wouldn’t Google be able to catch up easily if that was really OpenAI’s only advantage? Google has a lot more resources to throw at RL. It seems like there must be some other secret sauce for OpenAI to continue maintaining such a huge lead.