"We've beaten some hard problems more quickly than expected therefore we'll likely beat other hard problems more quickly than expected" is logical induction. It's equivalent to "I just flipped a coin and got heads. I'll probably get heads again on the next flip." Don't do that. :)
Do you really believe there's less than a 50% chance strong AI won't be invented in your lifetime?
I don't know. I don't really see the value in speculating.
Which is corrrect, if you don't know the true probability of flipping heads. You might find, for example, that it's a trick coin with two heads and no tails.
You absolutely can predict future progress from past progress. E.g. Moore's law held true for decades after the observation was made. If you see a technology advancing rapidly, then there is no reason to say it will stop in the near future!
>I don't really see the value in speculating.
Because everything depends on this prediction. The invention of AI will be the most significant event in the history of humanity. It will totally change the world. Or likely, destroy it. Being prepared for it is absolutely necessary.
By your logic, you can predict the failure of AGI predictions by past failures of (every) AGI prediction.
Why would you have a strong prior belief about the invention of AGI? Now you are claiming to have far more certainty than I am.
>By your logic, you can predict the failure of AGI predictions by past failures of (every) AGI prediction.
This logic is extremely flawed. First not every prediction was wrong. Many people predicted it would happen in 2045, a few in 2030.
Second there's no reason past predictions represent the accuracy of future predictions about the same thing. Predictions should get more accurate over time, and early predictions are expected to be wildly wrong.
And third there's anthropic bias. If they were right, then we wouldn't be here to speculate about it. We can only ever observe negative outcomes, therefore observing a negative outcome shouldn't update your priors at all.
The vast majority of predictions were wrong.
Yes, the logic is flawed, that's why I said it was your logic.
There is all kinds of value in speculating. We do it all the time in things like war games. 'If neighbor $x attacked us, what would happen?, would they win?, what can we do to prevent this?'.
Of course this may in your mind hold very little value now, but I promise if and when it occurs you will change your mind quickly on that topic.
That's the difference between a neural net -- which until about an hour ago was a phrase that reliably set off my snake-oil detector -- and a simple tree search. DeepMind just beat a Go master... and nobody can say exactly how it did it.
That's a big deal.
Remember that "solve computer vision" was considered a summer project.
And they're pretty much there. Have you seen some of the latest results in that field?
We certainly got nearly there, but it was nearly 50 years later, not 3 months. Similarly, something that might look somewhat simple to us right now, might also be a lot more difficult.
Good chess programs definitely use self-play to improve themselves, eg to tune parameters and heuristics.
We should be taking steps to outlaw black box algorithms right now but I'm sure we won't.
I can't understand the call to regulate a technology when it is decades (much more that 10-20 years) away from possibly existing in a state that we can't even imagine. Add to that legislators with zero technical literacy. That's essentially advocating for shutting down all research into a technology that can improve millions of lives.
Basically any algorithm where you are training it with tons of samples and then it creates a logic tree that is not written by a human is a black box algorithm.
By the time AI technology gets to the point that we realize we should regulate it we will be too late.
As hard as writing AI for a problem space like "how to win at Go" is, it's several orders of magnitude easier than creating a general AI with the self-awareness required to see us as a threat.