News for hackers. Stuff that matters.
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by UltraSane on Friday May 30, 2025 @11:28AM (#44137180)
I would LOVE to see an LLM trained simultaneously with ASICs optimized to run it. Or at least an FPGA design.
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by lawlessone on Friday May 30, 2025 @12:05PM (#44137578)
I think that's basically what nvidia and their competitor AI chips do now?
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by UltraSane on Friday May 30, 2025 @08:02PM (#44140869)
They use machine learning to optimize general purpose chips. I am proposing that you would train an LLM AND the ultra-optimized hardware that can only run that LLM at the same time. So the LLM and the Verilog design of the hardware to run it would be the output of the training
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by jalk on Friday May 30, 2025 @12:27PM (#44137783)
Can't find the reference now, but remember reading an article on evolving FPGA designs. The found optimum however only worked on the specific FPGA it was evolved on, since the algo had started to use some out-of-spec "features" of the specific chip. Obviously that can be fixed with proper constraints, but seems like a trap that could be stepped into again - i.e. the LLM is now really fast but only on GPUs that come from the same batch of wafers.
Re:The Darwin Gödel Machine: AI that improves itself by rewr... by jecel on Friday May 30, 2025 @12:55PM (#44138039)