Re:Competitive Programming with AlphaCode
by hackinthebochs on Wednesday February 02, 2022 @02:37PM
(#30182827)
The issue is these techniques are growing in capabilities exponentially, while we have a habit of extrapolating linearly. Some saw the glaring deficits in copilot then reasoned that linear improvements is still glaring deficits. I don't know that this bias can ever be corrected. A large number of intelligent people simply will never be convinced general AI is coming soon no matter what evidence is presented.
[ Parent
| on HN ]
Re:Competitive Programming with AlphaCode
by Jensson on Wednesday February 02, 2022 @02:59PM
(#30183151)
> techniques are growing in capabilities exponentially, while we have a habit of extrapolating linearly
What does this even mean? How do you put a number on AI capability? You can say it is growing faster than people expect, but what is even exponential or linear growth in AI capability?
Re:Competitive Programming with AlphaCode
by hackinthebochs on Wednesday February 02, 2022 @03:27PM
(#30183547)
I take your point that the linear/exponential terminology is a bit dubious. But the simple way to make sense of it is just going by various benchmarks. E.g. the power-law relationship between the model accuracy and the model size: https://eliaszwang.com/paper-reviews/scaling-laws-neural-lm/