News for hackers. Stuff that matters.

A comment on Can LLMs invent better ways to train LLMs?. Parent comment

Re:Can LLMs invent better ways to train LLMs? by mdp2021 on Thursday June 13, 2024 @01:22AM (#40666215)
> Can LLMs invent anything

Can they propose a working novelty:

-- after deep thought about idea soundness, probably not at this stage

-- through cycles of trials, not knowing exactly why - probably yes

After all, your hammer needs not intelligence.

[ Parent | on HN ]
Re:Can LLMs invent better ways to train LLMs? by steve1977 on Thursday June 13, 2024 @05:11AM (#40667509)
But my hammer is totally useless without me as a human using it and telling it exactly what to do.
[ Parent | on HN ]
Re:Can LLMs invent better ways to train LLMs? by mdp2021 on Friday June 14, 2024 @08:08AM (#40680087)
Yes, exactly. Tools perform without "knowing" the purpose. Unintelligent yet effective.

So, "perform a selection over the enumerated combinations in the solutions space" works without the process being further sophisticated. It works as much as it can - as a preparation of data until the stage in which intelligence is required.

We have been doing it since a while; simulated annealing, genetic algorithms... Dumb hammers in a way, encoding an action from an intelligent operator, and providing an effective aid when under intelligent control.

[ Parent | on HN ]