News for hackers. Stuff that matters.
Re:AI-first – We're just 6 months away from AGI by Flemlo on Monday June 02, 2025 @04:42AM (#44156835)
We do the same thing.

We have long term memory and short term.

Context is short term.

The still long and expensive training phase embeds the long term memory.

Re:AI-first – We're just 6 months away from AGI by queenkjuul on Monday June 02, 2025 @08:16AM (#44158030)
What we do may be analogous but absolutely not the same
Re:AI-first – We're just 6 months away from AGI by Flemlo on Monday June 02, 2025 @10:10AM (#44159040)
Yes if course after all ML and LLM are not made out of brain.

But do I really have to say colloquial?

Re:AI-first – We're just 6 months away from AGI by AnimalMuppet on Monday June 02, 2025 @01:13PM (#44160997)
Hmm, interesting.

One of the problems programmers have is loading a problem into working memory. It can take an hour. An interruption, a phone call, or a meeting can mean that you have to start over (or, if not completely over, you still have to redo part of it). This is a standard programmer complaint about interruptions.

It's interesting that LLMs may have a similar issue.

Re:AI-first – We're just 6 months away from AGI by 29athrowaway on Monday June 02, 2025 @07:34PM (#44164515)
We do not do the same thing.

Right now inference doesn't cascade into training.

In biology, inference and training are not so decoupled.