In this context, "leisure" is used to mean the stuff you do outside of work and chores essentially. If you want to work on a side project, that would fall under leisure time.