I "solved" this by running Slack on a second computer (even being on the same one with the same notification feed was no good). I occasionally look at it, but try to avoid doing so unless I'm at the start of a pomodoro period (because Slack is work, it gets a work period).