The first couple of google results just seem to say your view is a very common mistake/misunderstanding people make when confusion "not working" with leisure time.