News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by EMM_386 on Monday April 01, 2024 @01:58PM (#39897039)
> Either I'm a super genius or this has been discussed before and made it's way into the training data.

If an LLM can tell you the relatonship between a compost heap and nuclear bomb, that doesn't mean that was in the training data.

It could be because a compost heap "generates heat", and a nuclear bomb also "generates heat" and due to that relationship they have something in common. The model will pick up on these similar patterns. They tokens are positioned closer to each other in the high dimensional vector space.

But for any given "what does x have in common with y", that doesn't necessarily mean someone has asked that before and it's in the training data. Is that reasoning? I don't know ... how does the brain do it?

Re:LLaMA Now Goes Faster on CPUs by bamboozled on Monday April 01, 2024 @03:35PM (#39898195)
I mean that’s what sucks about Open AI isn’t it ? They won’t tell us what is in the training data so we don’t know. All I’m saying is that it wouldn’t be surprising if this was discussed previously somewhere in a pop science book.

That answer was close btw !

Re:LLaMA Now Goes Faster on CPUs by moffkalast on Monday April 01, 2024 @02:42PM (#39897587)
> how does the brain do it?

It's a lot of organic matmuls. ;)