News for hackers. Stuff that matters.
Re:Learning to Reason with LLMs by KK7NIL on Thursday September 12, 2024 @02:34PM (#41524035)
The absolute time depends on hardware, optimizations, exact model, etc; it's not a very meaningful number to quantify the reinforcement technique they've developed, but it is very useful to estimate their training hardware and other proprietary information.
Re:Learning to Reason with LLMs by j_maffe on Thursday September 12, 2024 @03:22PM (#41524520)
It's not about the literally quantity/value, it's about the order of growth of output vs input. Hardware and optimizations don't really change that.
Re:Learning to Reason with LLMs by KK7NIL on Thursday September 12, 2024 @03:41PM (#41524684)
Exactly, that's why the absolute computation time doesn't matter, only relative growth, which is exactly what they show.