News for hackers. Stuff that matters.
Re:America is getting an AI gold rush instead of a factory boom by musebox35 on Tuesday October 14, 2025 @01:19PM (#45582545)
While I agree with the general sentiment on throwaway compute infra, the generated know-how with large scale experiments is not thrown away. I think a lot hinges on the scaling laws and whether you will hit the jackpot at a certain scale before everyone else. This is hard to guesstimate so someone has to do it in the spirit of empiricism. This might sound a lot like gambling or exploring depending on your sentiment. So, I think it is more justified to criticize the scale and the risks than the spirit of these investments.
Re:America is getting an AI gold rush instead of a factory boom by whatshisface on Tuesday October 14, 2025 @01:46PM (#45582783)
While scaling laws are only empirical curve fitting and extrapolation, none of them predict a discontinuous "jackpot effect."
Re:America is getting an AI gold rush instead of a factory boom by musebox35 on Wednesday October 15, 2025 @02:02AM (#45588570)
AFAIK, certain abilities such as understanding arithmetic manifest at discrete scale points even though there is a continuous build up of potential. There is also the more remote possibility of a discrete scale that AI takes over its own training or at least starts to contribute substantially. A lot of real world leverage and arbitrage depends on such discrete surprises that may not be visible during the continuous incremental evolution. I think this principle holds computationally as much as it does biologically.