Re:Large Language Models for Mathematicians
by hnax on Saturday February 01, 2025 @02:39PM
(#42901432)
I'm afraid you're overlooking the fact that, since AI scales linearly with constraints and exponentially with compute, the importance of knowledge (i.e. constraints) dominates over data (i.e. compute) for AI to be useful.
Now it's out of date, automated RL on math problems seems to work and scales with compute. As we scale available compute 100x over the next 5 years and reduce cost of compute by around 10x over the same time frame, it will become increasing clear that LLMs running for a long time are capable of replacing most mathematics research.