GitHub cuts AI deals with Google, Anthropic

Re:GitHub cuts AI deals with Google, Anthropic by sdesol on Tuesday October 29, 2024 @06:00PM (#41989868)

Animals are capable of learning. LLMs can not. LLM uses weights that are defined during the training process to decide what to do next. LLM cannot self evaluate based on what it has said. You have to create a new message for it to create a new probability path.

Animals have the ability to learn and grow by themselves. LLMs are not intelligent and I don't see how they can be since they just follow the most likely path with randomness (temperature) sprinkled in.

[ Parent | on HN ]

Re:GitHub cuts AI deals with Google, Anthropic by digging on Wednesday October 30, 2024 @09:54AM (#41994762)

Ok so just to be clear, that's an entirely different and unrelated argument from the one I responded to.

Second, it's wrong. LLMs can learn within their context window. The main issue now is the limited size of their context window; animals have a lifetime of compressed context and LLMs only have approximately one conversation.

[ Parent | on HN ]

Re:GitHub cuts AI deals with Google, Anthropic by sdesol on Wednesday October 30, 2024 @10:30AM (#41995327)

> Ok so just to be clear, that's an entirely different and unrelated argument from the one I responded to.

It honestly made no sense what you were saying so I didn't respond to that directly as I assumed it would be clear from my explanation as to why animals can be intelligent and LLM are not.

> LLMs can learn within their context window.

They don't learn from the context window as much as they use what is in the context window to define a probabilistic path. If you put something in the context window that it was never trained on, it would spit out BS or say it doesn't know.

[ Parent | on HN ]