You can say "Alexa, stop by the way" and it will disable it for a time, but it will come back. If you really want to disable it for good, you can set up a routine to effectively issue this "snooze" on by the way at some interval.