- FSD is one example, but the improvement of computer vision since 2015 has been massive and deep learning approaches to general problem solving too. This wasn’t something people were predicting in 2010.
- The deep blue and stock fish style approaches vs. the alpha go or alpha zero approaches are categorically different - the latter being a lot more interesting and closer to general learning vs. the older approach which is more like brute force.
- GOFAI was a bad approach and the optimism in the 60s was wrong. Today’s looks more promising. Being wrong in the 60s doesn’t necessarily mean people are wrong now. It’s hard to know: https://intelligence.org/2017/10/13/fire-alarm/
For the AGI bit I’d recommend reading some of Eliezer Yudkowsky’s writing or Bostrom’s book (though I find Bostrom’s writing style tedious). There’s a lot of good writing about take offs and AGI/goal alignment that’s worth reading to get a base level understanding of the concepts people have thought through.
AGI doesn’t need to be human like to be dangerous - it can be good at general problem solving with poorly aligned goals and just act much faster. Brains exist everywhere in nature, simpler than human brains. A lot of that computation in training could be an analog of the genetic “pre-training” of evolution for humans that gets our baseline which could be one reasons humans don’t seem to require so much. There was a massive amount of “computation” over time via natural selection to get to our current state.
> plot the improvements in AI and the usage of computational power for AI on the same chart.
Would that be meaningful? I mean, I use an infinity times the computational power for writing a letter than people did 100 years ago, still producing more or less the same results.
That's hardly accurate - didn't Musk and Co. promise self-driving cars by 2012? We're in 2020, and the SDC's are great for making youtube videos, but not any good at piloting a vehicle without human intervention.
Since the 90s it has been clear that the only thing holding back what we have today is limited processing power. While there may be some new insights and directions in AI, they are not "general" and they require 3 orders of magnitude more processing power for a lot smaller improvement in performance.
What has been clear since 2010 is that this field has passed the point of diminishing returns already. We throw vastly more computational power at problems that we ever did before, and then call the result an improvement.
Deep blue beat the best human at chess using 11.8 GFLOPS of computational power. Alphago beat the best human at go using 720000 GFLOPS of power. The complexity difference between Chess and Go are within a single order of magnitude - 10x to 99x difference in complexity (https://en.wikipedia.org/wiki/Game_complexity). The difference in AI processing power to beat the best human between Chess and Go is between 4 and 5 orders of magnitude (1000x and 100000x).
This does not look like a success to me - it looks like a brute-force approach. If you spend 10000x more resources for a 10x more benefit, you're at the point of diminishing returns.
Here's a great paper that should be written (but won't be) - plot the improvements in AI and the usage of computational power for AI on the same chart.
From the 90s (https://en.wikipedia.org/wiki/History_of_self-driving_cars#1...): "The robot achieved speeds exceeding 109 miles per hour (175 km/h) on the German Autobahn, with a mean time between human interventions of 5.6 miles (9.0 km), or 95% autonomous driving."
Yup, 95% autonomous. Today we have 95.x% autonomous with roughly 10000x the resource power thrown at the problem.
So, yeah, your assertion that "Few would have predicted the results we’re seeing today in 2010." is wildly off mark, we predicted more than what we see today because we did not expect to hit a point of diminishing returns quite so quickly.
The people who did the 95% SDC in 1997 would have been disbelieving if anyone told them, in 1997, that even with 10000x more processing power thrown at the problem and new sensor hardware that was not available to them, it won't get much better than what they had.