Re:Efficiency is dangerous and slowing down makes life better
by BeatLeJuce on Friday August 21, 2020 @05:37PM
(#24239126)
No, it isn't. The b/v tradeoff is not the same thing. The efficiency of an estimator is a different from its bias.
[ Parent
| on HN ]
Re:Efficiency is dangerous and slowing down makes life better
by ianhorn on Friday August 21, 2020 @10:30PM
(#24241080)
> The efficiency of an estimator is a different from its bias.
I think the comment is drawing a parallel to variance (better efficiency = lower variance). Still not exactly the same, I think, but pretty damn similar.
Re:Efficiency is dangerous and slowing down makes life better
by xapata on Saturday August 22, 2020 @02:43AM
(#24242213)
They're related in that less complex models will degrade more gracefully when making predictions on novel anomalies, and that in general model complexity drives the bias-variance trade-off.
But, erring on the side of efficiency in this discussion is more like over-fitting, which implies an overly complex model. It's making your model too good for one situation, such that it fails to generalize. You'd rather pull back on accuracy and choose a simpler model, in the hopes that it's more resilient to novel observations.