The first statement may be referring to the Cramer-Rao bound:
https://en.wikipedia.org/wiki/Cram%C3%A9r%E2%80%93Rao_bound
But it only applies to estimation (like how well a population parameter can be estimated) in certain regimes, and not e.g. expected risk (like how well one can do at prediction), so I’m not sure how it would apply here.
Re:Deep Learning's Diminishing Returns
by 6gvONxR4sf7o on Friday September 24, 2021 @07:05PM
(#28648774)
For the former, you can find reasonably general forms of it in mathematical statistics books. For the latter, I'd love to know too.
Those claims are entirely new to me, and I've been a researcher in the field for almost 10 years. Where do they come from/what theorems are they based on? It's unfortunate this article doesn't have any citations.