This was my experience as well. Doing "quant" trading on the side quickly becomes a second job, as you are always adjusting, training, simulating, and even just observing the models you're using.

It's not impossible to make money though. When it comes down to it, the trade-off for the hours you put in and the money you make only really pays off if you're trading with someone else's money, and lots of it.