What “game over” for the latest paradigm in AI might look like Posted by FlawedReformer on Sunday October 30, 2022 @03:25AM from the garymarcus.substack.com dept. https://garymarcus.substack.com/p/what-game-over-for-the-latest-paradigm ( 5 comments | 2 points | on HN )
> 1. There might not be enough data in the world to make scaling maximalism work. https://arxiv.org/pdf/2209.12407.pdf
> 2. There might not be enough available compute in the world to make scaling maximalism feasible.
> 3. Some important tasks might simply not scale. https://arxiv.org/abs/2002.06177
Note: scaling maximalism hypothesis -> "that AGI might arise from larger scale without fundamental new innovation"
Reminds me of that concept Steven Wolfram introduced me to called computational irreducibility