News for hackers. Stuff that matters.

A comment on Competitive Programming with AlphaCode. Parent comment

Re:Competitive Programming with AlphaCode by Jensson on Wednesday February 02, 2022 @02:59PM (#30183151)
> techniques are growing in capabilities exponentially, while we have a habit of extrapolating linearly

What does this even mean? How do you put a number on AI capability? You can say it is growing faster than people expect, but what is even exponential or linear growth in AI capability?

[ Parent | on HN ]
Re:Competitive Programming with AlphaCode by hackinthebochs on Wednesday February 02, 2022 @03:27PM (#30183547)
I take your point that the linear/exponential terminology is a bit dubious. But the simple way to make sense of it is just going by various benchmarks. E.g. the power-law relationship between the model accuracy and the model size: https://eliaszwang.com/paper-reviews/scaling-laws-neural-lm/
[ Parent | on HN ]