News for hackers. Stuff that matters.

A comment on Large Language Models for Mathematicians. Parent comment

Re:Large Language Models for Mathematicians by hnax on Saturday February 01, 2025 @02:39PM (#42901432)
I'm afraid you're overlooking the fact that, since AI scales linearly with constraints and exponentially with compute, the importance of knowledge (i.e. constraints) dominates over data (i.e. compute) for AI to be useful.
[ Parent | on HN ]
Re:Large Language Models for Mathematicians by mgraczyk on Saturday February 01, 2025 @04:31PM (#42902571)
Not sure what you're talking about, what does it mean to say that it scales "exponentially with compute"? You're talking about scaling laws? In what sense are they "linearly with knowledge"?
[ Parent | on HN ]