Re:What makes collapse inevitable and imminent
by FeepingCreature on Wednesday May 04, 2022 @09:56PM
(#31268457)
Seems too focused on the NYT article? I don't think this because the NYT said so, I think this because PaLM's chains-of-thought approach seems to match how my own brain works. I think LMs have huge intelligence overhang atm that is hidden by the way they are forced to respond. If we figure out how to train LMs with propagation through hidden chains of thought, we'll see a huge jump in capability, and also this is the obvious next step that the industry will aim for.
Reasoning: https://medium.com/@emilymenonbender/on-nyt-magazine-on-ai-r...