With small datasets you need to know how the concept drifts well enough to model it or model the failure modes. That's half the game in my opinion.