News for hackers. Stuff that matters.
Re:AI-first – We're just 6 months away from AGI by 29athrowaway on Monday June 02, 2025 @04:23AM (#44156707)
No, we are not. Pretrained models do not learn from their prompts. Their state is volatile.
Re:AI-first – We're just 6 months away from AGI by cnity on Monday June 02, 2025 @04:24AM (#44156715)
Read the article: it is criticizing the claim.
Re:AI-first – We're just 6 months away from AGI by 29athrowaway on Monday June 02, 2025 @04:27AM (#44156729)
Me too.
Re:AI-first – We're just 6 months away from AGI by Flemlo on Monday June 02, 2025 @04:42AM (#44156835)
We do the same thing.

We have long term memory and short term.

Context is short term.

The still long and expensive training phase embeds the long term memory.

Re:AI-first – We're just 6 months away from AGI by queenkjuul on Monday June 02, 2025 @08:16AM (#44158030)
What we do may be analogous but absolutely not the same
Re:AI-first – We're just 6 months away from AGI by Flemlo on Monday June 02, 2025 @10:10AM (#44159040)
Yes if course after all ML and LLM are not made out of brain.

But do I really have to say colloquial?

Re:AI-first – We're just 6 months away from AGI by AnimalMuppet on Monday June 02, 2025 @01:13PM (#44160997)
Hmm, interesting.

One of the problems programmers have is loading a problem into working memory. It can take an hour. An interruption, a phone call, or a meeting can mean that you have to start over (or, if not completely over, you still have to redo part of it). This is a standard programmer complaint about interruptions.

It's interesting that LLMs may have a similar issue.

Re:AI-first – We're just 6 months away from AGI by 29athrowaway on Monday June 02, 2025 @07:34PM (#44164515)
We do not do the same thing.

Right now inference doesn't cascade into training.

In biology, inference and training are not so decoupled.