News for hackers. Stuff that matters.
Re:Botrnot: an R package for detecting Twitter bots by tysonzni on Thursday March 15, 2018 @01:02AM (#16590509)
Do we know that no cross validation was done? I couldn't figure out what the dataset is or where it came from just by looking at the repo.
Re:Botrnot: an R package for detecting Twitter bots by minimaxir on Thursday March 15, 2018 @01:38AM (#16590640)
k-fold cross-validation was done (the cv.folds parameter to gbm), but that doesn’t help when the model overfits like hell.
Re:Botrnot: an R package for detecting Twitter bots by gerty on Thursday March 15, 2018 @03:59AM (#16591091)
I agree this is probably what happened. From the estimation object I see around a total of 3500 training samples with around 90 predictors. 3-fold cross-validation was done so at each iteration only around 2150 samples were used for training... And it seems none of the samples were used for out-of-sample checking.