News for hackers. Stuff that matters.
Re:GitHub cuts AI deals with Google, Anthropic by digging on Wednesday October 30, 2024 @09:54AM (#41994762)
Ok so just to be clear, that's an entirely different and unrelated argument from the one I responded to.

Second, it's wrong. LLMs can learn within their context window. The main issue now is the limited size of their context window; animals have a lifetime of compressed context and LLMs only have approximately one conversation.

Re:GitHub cuts AI deals with Google, Anthropic by sdesol on Wednesday October 30, 2024 @10:30AM (#41995327)
> Ok so just to be clear, that's an entirely different and unrelated argument from the one I responded to.

It honestly made no sense what you were saying so I didn't respond to that directly as I assumed it would be clear from my explanation as to why animals can be intelligent and LLM are not.

> LLMs can learn within their context window.

They don't learn from the context window as much as they use what is in the context window to define a probabilistic path. If you put something in the context window that it was never trained on, it would spit out BS or say it doesn't know.