News for hackers. Stuff that matters.
Re:OpenAI, Google and Anthropic Are Struggling to Build More... by fullstackchris on Friday November 15, 2024 @05:29AM (#42145571)
Comments like these are so prevalent and yet illustrate very well the lack of understanding of the underlying technology. Neural nets, once trained, are static! You'll never get dynamic "through-time" reasoning like you can with a human-like mind. It's simply the WRONG tool. I say human-like because I still think AGI could be acheived in some digital format, but I can assure you it wont be packaged in a static neural net.

Now, neural nets that have a copy of themselves, can look back at what nodes were hit, and change through time... then maybe we are getting somewhere

Re:OpenAI, Google and Anthropic Are Struggling to Build More... by hackinthebochs on Friday November 15, 2024 @09:04AM (#42147035)
The context window of LLMs gives something like "through time reasoning". Chain of thought goes even further in this direction.