Re:What it takes to build great machine learning products
by tel on Tuesday April 17, 2012 @12:18PM
(#3853322)
I've heard that line referred to as Box's Razor. It's definitely the right heuristic, but it's interesting to see that even if your model is right, you're still in trouble if it's too complex. This is a sort of bias/variance tradeoff.
You can build an extremely complicated model that is not useful, where a simpler one might suffice.