News for hackers. Stuff that matters.
Re:Any insider takes on Yann LeCun's push against current ar... by throwawaymaths on Friday March 14, 2025 @08:05PM (#43368625)
i dont think the stochasticity that's the problem -- the problem is that model gets "locked in" once it picks a token and there's no takesies backsies.

that also entails information destruction in the form of the logits table, but for the most part that should be accounted for in the last step before final feedforward

There are no comments on this comment yet.