News for hackers. Stuff that matters.
Re:AlphaEvolve: A Gemini-powered coding agent for designing ... by knowaveragejoe on Wednesday May 14, 2025 @11:57PM (#43991711)
> The “knowledge retrieval” stage may hallucinate, but—because the knowledge is expressed as code—we can execute it and validate the result against a custom evaluation function.

Can you give a concrete example of this? It's hard for me to conceptualize.

Re:AlphaEvolve: A Gemini-powered coding agent for designing ... by aseg on Thursday May 15, 2025 @02:28PM (#43997845)
Assume you have data for Hooke's law (a spreadsheet with F, x, and other variables) and you want AlphaEvolve to give you the equation ``F = -C_1*x``.

Let's say the model hallucinates in two directions:

1. "There is a trigonometric relationship between variable F and x". It expresses this as ``F = -C_1*sin(x)``. You fit the constant C_1 w.r.t the dataset, execute the program, and your best fit has a high error. You can discard the program.

2. "There is an inverse linear relationship between variable F and x". Now it expresses this as ``F = -C_1*x``. You fit the constant C_1 w.r.t the dataset, execute the program, and your best fit has extremely low error. You now know for sure that you're on the right track.