Re:Some thoughts on machine learning with small data
by nri on Friday June 03, 2022 @08:48AM
(#31607490)
You are right, data/concept drift affects both approaches.
What I meant to say was that retraining your model might not fix that if you baked strong assumptions into it. I edited the blog post to make it clearer.
Re:Some thoughts on machine learning with small data
by crabbygrabby on Friday June 03, 2022 @12:12PM
(#31610322)
With small datasets you need to know how the concept drifts well enough to model it or model the failure modes. That's half the game in my opinion.
Isn't this a problem anyway, even with models based on much larger datasets?