News for hackers. Stuff that matters.
Re:Things we learned about LLMs in 2024 by nashadelic on Wednesday January 01, 2025 @04:00AM (#42564855)
I actually get annoyed when experienced folks say this isn't AGI, its next word predict and not human-like intelligence. But we don't know how human intelligence works. Is it also just a matrix of neuron weights? Maybe it ends up looking like humans are also just next-word/thought predictors. Maybe that is what AGI will be.
Re:Things we learned about LLMs in 2024 by miki123211 on Wednesday January 01, 2025 @06:04AM (#42565325)
A good enough next-word predictor IS AGI.

If there's something that you can prompt with e.g. "here's the proof for Fermat's last theorem" or "here is how you crack Satoshi's private key on a laptop in under an hour" and get a useful response, that's AGI.

Just to be clear, we are nowhere near that point with our current LLMs, and it's possible that we'll never get there, but in principle, if such a thing existed, it would be a next-word predictor while still being AGI.

Re:Things we learned about LLMs in 2024 by mewpmewp2 on Wednesday January 01, 2025 @07:00AM (#42565522)
This by the common definition isn't AGI yet, not to say it couldn't be. But if it was AGI it would be extremely clear, since it would also be able to control the physical form of itself. It needs robotics and to be able to navigate the world to be able to be AGI.
Re:Things we learned about LLMs in 2024 by latexr on Wednesday January 01, 2025 @07:24AM (#42565622)
> I actually get annoyed when experienced folks say this isn't AGI, its next word predict and not human-like intelligence. But we don't know how human intelligence works.

I’m pretty sure you’re committing a logical fallacy there. Like someone in antiquity claiming “I get annoyed when experienced folks say thunderstorms aren’t the gods getting angry, it’s nature and physical phenomena. But we don’t know how the weather works”. Your lack of understanding in one area does not give you the authority to make a claim in another.

Re:Things we learned about LLMs in 2024 by deterministic on Friday January 03, 2025 @03:02AM (#42583608)
A human can learn from just a few examples of chairs what a chair is. Machine learning requires way more training than that. So there does seem to be a difference in how human intelligence works.