If you can train an NN in a day, then you can probably train SVD in minutes/hours- so why not start with it? Otherwise you might not even recognize the symptoms of bad hyperparameters fo r the NN resulting in poor performance.