News for hackers. Stuff that matters.
Re:Do Large Language Models learn world models or just surfa... by simonh on Sunday January 22, 2023 @05:22AM (#34475996)
Even assuming that curve fitting is actually in any way a meaningful description, let’s say I give you that. It tells us absolutely nothing about the mechanisms evolved in the neural pathways, how it encodes memory if the current game distinctly from memory of past games, the reasons for the strength or weaknesses of one trained instance against another, or ways we could optimise the architecture to better complement the way it function. It doesn’t help us engineer the system, or reason about its possible limitations or failure modes. In other words it doesn’t tell us anything actually useful about it.
Re:Do Large Language Models learn world models or just surfa... by tdullien on Sunday January 22, 2023 @06:20AM (#34476303)
So how does mysticism and unprovable-and-likely-false analogies-to-life help the engineering?
Re:Do Large Language Models learn world models or just surfa... by simonh on Sunday January 22, 2023 @10:27AM (#34478233)
What are you even talking about?