Whenever I make a model I always do cross-validation to make sure that I'm not overfitting. If we were just fitting random noise I would always see the performance of my test set being no better than chance (or worse).