News for hackers. Stuff that matters.

A comment on Advancements in machine learning for machine learning. Parent comment

Re:Advancements in machine learning for machine learning by IanCal on Saturday December 16, 2023 @03:07AM (#38662645)
The important thing is "how do you change X so that it heads towards the goal". And "how to do it quickly and efficiently".

Otherwise the description is the same as "select randomly, keep the best, iterate".

The goal is also complex. You might be thinking of "find the most efficient program" but that's not what we're doing here iiuc. We're trying to get a program that makes other unseen programs more efficient. That's hard to define as a goal.

[ Parent | on HN ]
Re:Advancements in machine learning for machine learning by Jensson on Saturday December 16, 2023 @05:54AM (#38663336)
> Otherwise the description is the same as "select randomly, keep the best, iterate".

That is what they did though. The LLM didn't know what problem it was "solving".

[ Parent | on HN ]
Re:Advancements in machine learning for machine learning by IanCal on Saturday December 16, 2023 @09:07AM (#38664283)
That's not really true unless you're ignoring the rest of my points. The process did not just uniformly randomly create programs.

They also don't just keep the best and search from that point but feed the resulting programs and their scores into an LLM.

[ Parent | on HN ]
Re:Advancements in machine learning for machine learning by Jensson on Saturday December 16, 2023 @09:28AM (#38664426)
They did remove the worst results from the group over time, the others was just uses a seed to generate new examples from instead of starting each function from scratch.
[ Parent | on HN ]