News for hackers. Stuff that matters.
Re:Total Crap, the First Magazine Written by AI by the8472 on Tuesday May 09, 2023 @11:56AM (#35876331)
memory, internal iteration and scratchpads can and have been added. Foundation models don't include this yet, but it's not unexplored territory. Online learning is more difficult but I'd argue that various fine-tuning and control approaches are slowly working towards that.

So what is a brain other than a very complex non-linear function which takes inputs, iterates on them, integrates them with memory and eventually generates output?

> is that it doesn't truly understand anything at all, but is just instead (in simple terms) a large matrix of inputs to outputs

The first step to defeating the tiger is to realize that it cannot hurt you, for it is only made of simple atoms.

Re:Total Crap, the First Magazine Written by AI by mgn115 on Tuesday May 09, 2023 @12:59PM (#35877206)
> So what is a brain other than a very complex non-linear function which takes inputs, iterates on them, integrates them with memory and eventually generates output?

A thing that processes and embodies sensory input, makes informed guesses about other people's intentions and values, grows tumors, worries about the dirty dishes.... How many other "complex non-linear functions" are made of meat?

Re:Total Crap, the First Magazine Written by AI by ukuina on Wednesday May 10, 2023 @01:55AM (#35884113)
>> is that it doesn't truly understand anything at all, but is just instead (in simple terms) a large matrix of inputs to outputs

> The first step to defeating the tiger is to realize that it cannot hurt you, for it is only made of simple atoms.

This is now my favorite rebuttal when people claim LLMs are simply some form of math.