The error was too high so I haven't integrated it into the actual code base yet, so it hasn't been a problem in practice yet! Ha. Yes I think the best thing I can do will be to collect more data, I am hoping that will close the gap a bit more. Also, I haven't spent that much time tuning hyperparameters.