News for hackers. Stuff that matters.
Re:OpenAI, Google and Anthropic Are Struggling to Build More... by lxgr on Thursday November 14, 2024 @02:15PM (#42140011)
Are you arguing that writing, doing math, going to the moon etc. were all in the "original training set" of humans in some way?
Re:OpenAI, Google and Anthropic Are Struggling to Build More... by layer8 on Thursday November 14, 2024 @02:31PM (#42140169)
Not in the original training set (GP is saying), but the necessary skills became part of the training set over time. In other words, human are fine with the training set being a changing moving target, whereas ML models are to a significant extent “stuck” with their original training set.

(That’s not to say that humans don’t tend to lose some of their flexibility over their individual lifetimes as well.)

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by Jensson on Thursday November 14, 2024 @10:33PM (#42143746)
> (That’s not to say that humans don’t tend to lose some of their flexibility over their individual lifetimes as well.)

The lifetime is the context window, the model/training is the DNA. A human in the moment isn't general intelligent, but a human over his lifetime is, the first is so much easier to try to replicate though but that is a bad target since humans aren't born like that.