News for hackers. Stuff that matters.
Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by sharemywin on Friday January 06, 2023 @11:45PM (#34285301)
I think these LLMs have been optimized with Reinforcement Learning from Human Feedback (RLHF)

Hard to tell that will add enough to get close to AGI.

Google is also working on chain of thought prompting which helps with math and logic problems.

https://medium.com/nlplanet/two-minutes-nlp-making-large-lan...

Re:A Skeptical Take on ChatGPT: Ezra Klein Interviews Gary M... by lossolo on Saturday January 07, 2023 @12:20AM (#34285472)
COT is so yesterday! SOTA is LAMBADA[1] aka backward chaining also from Google, that significantly outperforms chain of thought and select inference in terms of prediction accuracy and proof accuracy.

[1] https://arxiv.org/abs/2212.13894