It's interesting what hypotheticals, straw men really, that we project in our minds as we read. When he said "doing nothing" I pictured a literally homeless man drifting through life. Such people can certainly "afford" to do nothing. You presumably pictured something different. In any case neither of us is likely imagining what OP has actually lived.