There are two aspects to the feature. There's not a setting to disable that one. I've disabled the setting that does exist but the while-you-were-away version of the feature persists.