Re:The Bitter Lesson Is Misunderstood – By Kushal Chakrabarti
by yberreby on Thursday September 04, 2025 @01:09AM
(#45123788)
If C ~ D^2, then D ~ sqrt(C).
In other words, the required amount of data scales with the square root of the compute. The square root of 2 ~= 1.414. If you double the compute, you need roughly 1.414 times more data.
In other words, the required amount of data scales with the square root of the compute. The square root of 2 ~= 1.414. If you double the compute, you need roughly 1.414 times more data.