News for hackers. Stuff that matters.
Re:Google DeepMind by qumpis on Thursday April 20, 2023 @03:13PM (#35644784)
Rlhf wasn't introduced by openai. And GPT is a pretty standard transformer, no? Yes they did it at scale and it speaks volumes on their production skills, but OP was asking about research
Re:Google DeepMind by jerpint on Friday April 21, 2023 @11:47AM (#35655545)
GPT is a specific instantiation of a transformer, and doing next token prediction was an openAI thing. Transformers were a big part of it, but GPT was def proposed but openAI